Don't worry, we can still help! Below, please find related information to help you with your job search.
Data Engineer Jobs
Company | MetaPhase Consulting |
Address | Washington DC-Baltimore Area, United States |
Employment type | FULL_TIME |
Salary | |
Category | IT Services and IT Consulting,Software Development,Business Consulting and Services |
Expires | 2023-06-26 |
Posted at | 11 months ago |
The US Marshals Service (USMS), Judicial Security Division (JSD) requires a data engineer to assist with building architectures that include databases and large-scale processing systems. The data engineer must be able to recommend and implement ways to improve data reliability, efficiency, and solve other data-related problems. This job requires someone with the ability to build and manage the architecture required for large data pipelines, including web scraping techniques.
Role Summary
Our work at Marshals is helping to keep the judicial system in the United States safe. You’ll work on a team in a high-impact, quick-moving environment, working alongside experienced practitioners to help you get up-to-speed, developing your skills, and delivering impact to clients.
MetaPhase is seeking a Data Engineer with 3+ years of hands-on experience with designing, developing, implementing, and maintaining robust solutions for processing large datasets.
What You Will Be Doing
- Apply understanding of data integration and artificial intelligence to introduce innovative techniques that mature capabilities.
- Apply understanding of data governance and data management best practices to implement secure and reliable data solutions.
- Collaborate with other engineers to architect and build data solutions that provide security for the judicial system.
- Use large-scale web scrapers to collect critical data while protecting them from site bans, IP leaks, browser crashes, CAPTCHA, and proxy failures.
- Work with large datasets to build and maintain data pipelines and workflows that support streaming data solutions.
What We Need From You (Required)
- Programming skills in the following languages: Python, SQL, JavaScript (with Python being the top priority).
- Familiarity with tools and techniques for crawling, extracting, and processing data (e.g., pandas, Scrapy, Beautiful Soup, SQL, etc.).
- Experience with large-scale web scrapers, including familiarity with a big data stack (e.g., Airflow, Spark, Hadoop, MapReduce, Hive, Kafka, Storm, and equivalent cloud-native services).
- Experience architecting and implementing large operational data stores, including ETL development of pipelines.
- Understanding of web technologies and tools (HTML, JavaScript, CSS, JSON, Selenium, APIs, etc.).
- Familiarity with at least one cloud-based framework (e.g., AWS, Azure, Google) with AWS being the preference.
Work Location
Hybrid – On-site in Arlington, VA, with options for remote work occasionally.
Travel - None
Education Level - Bachelor’s degree required in Computer Science or similar major; Advanced degree preferred.
Clearance Level - SECRET Clearance is required TOP SECRET Clearance is Highly PREFERRED; U.S. Citizenship required (NO EXCEPTIONS)
About MetaPhase Consulting
MetaPhase Consulting is different with a purpose - demonstrating a new approach to the industry that puts employees and culture first! We continue to be recognized by industry as one of the fastest growing and most impactful consultancies in the nation, and are aggressively hiring to grow our team:
Fastest Growing
- Washington Technology Fast 50 Award - 2020, 2021
- Inc 5000 Fastest Growing Company - 2020, 2021, 2022
- Financial Times America's Fastest Growing Companies – 2021, 2022
Best Places to Work
- Washington Post Best Places to Work – 2022
- Virginia Business Magazine's Best Places to Work – 2021, 2022, 2023
- Washington's Business Journal’s Best Places to Work – 2021, 2022
- Northern Virginia Technology Council Top 100 Technology Firms – 2020
MetaPhase Consulting is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, or any other factors protected by federal, state, or local law.
-
Systems Analyst - Excel, Xml, Sql, Scripting
By CyberCoders At Salt Lake City, UT, United States 8 months ago
-
(Senior) Finance & Shared Services Manager
By Catholics For Choice At Washington, DC, United States 8 months ago
-
Paralegal - Probate Administration
By CyberCoders At Miami, FL, United States 8 months ago
-
Account Executive - Automotive Software
By ECW Search At United States 8 months ago
-
Construction Project Coordinator Jobs
By CyberCoders At River Falls, WI, United States 8 months ago