Etl Developer Jobs

Description:

Position Summary:

This position will be supporting and working on one of Sparksoft’s technical projects. The ideal candidate will have experience in developing data ingestion and transformation ETL processes for analytical data loads, from a technical perspective.

Responsibilities:

• Analyze and recommend optimal approach for obtaining data from diverse source systems.
• Write scalable code using Python programming language, test and debug and deploy code.
• Integrate user-facing elements using server-side logic and develop back-end components.
• Develop Spark programs on Databricks to perform tasks like data cleansing, validation, standardization, and then applied transformations as per the use cases.
• Ability to integrate multiple data sources into a single system.
• Interface with business stakeholders to understand requirements and offer solutions.
• Work with the business analysts to understand application requirements.
• Assess and prioritize client requests based on the efforts required to code the requirements.
• Work closely with the data architects, who maintain the data models, including data dictionaries/metadata registry.
• Monitoring performance and advising any necessary infrastructure changes
• Design and Develop Databricks engineering solutions on AWS cloud.
• Performance tuning of end-to-end ETL integration processes.
• Select and integrate any Big Data tools and frameworks required to provide requested capabilities.
• Design, develop, test and release ETL solutions including data quality validations and metrics that follow data governance and standardization best practices.
• Improve functionality of existing systems.
• Improve responsiveness and overall performance of the software systems

Requirements:

Required Skills:

• Familiarity with front-end technologies (like JavaScript and HTML5).
• Techniques for testing ETL data pipelines either manual or using tools
• Good experience working on AWS Cloud.
• Experience in building, maintaining Unix shell script
• Ability to lead designing and implementation of ETL data pipelines.
• Strong SQL coding; Strong experience in Scala/ Java/Python , understanding of SQL and No SQL statement optimization/tuning.
• Experience in designing and developing applications in Spark using Scala that work with different file formats like Text, Sequence, Xml, parquet and Avro
• Knowledge of using Data bricks.
• Experience developing data quality checks and reporting to verify ETL rules and identify data anomalies.
• Proficient understanding of distributed computing principles and hands on experience in Big Data Analytics and development
• Good knowledge of Hadoop and Spark ecosystems including HDFS, Hive, Spark, Yarn.

Desired:

• Experience with CMS Marketplace eligibility and appeal processing
• Experience with contact center operations
• Experience with case management workflows

Required:

• Candidates must be able to obtain and maintain a Public Trust clearance
• Candidates must have lived in the United States 3 out of the past 5 years

Education:

• 4+ years of experience with establishing comprehensive test practices and methodologies
• Bachelor’s Degree in Engineering, Computer Science, Business Administration, Software Engineering or Related Field

Sparksoft is a certified Capability Maturity Model Integration (CMMI) SVC and DEV Level 3, ISO 9001:2015, ISO 27001:2013, Small Disadvantaged Business (SDB), Women-Owned Small Business (WOSB), and Small, Women-owned, Minority-owned (SWaM), and MBE/DBE/SBE consulting firm. With our focused mission “to ignite innovation, inspire transformation, and implement digital solutions for a healthier nation”, we specialize in 6 specific digital health services: Test Automation, Cloud Services, DevOps Delivery, Cyber Security, Data Science, and Human-Centered Design. Since 2004, our exceptionally skilled people, proven leadership, and optimized processes all work together relentlessly to continuously push for more efficient solutions.

Sparksoft is an Affirmative Action/Equal Opportunity Employer and does not discriminate against any applicant for employment or employee because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status, or any other characteristic prohibited under Federal, State, or local laws.

If you need accommodation seeking employment with Sparksoft Corporation, please email [email protected] or call 410-424-7700. Accommodations are made on a case-by-case basis.

At Sparksoft Corporation, we take security and protection of personal information very seriously. We will never ask you to send private personal information over email. Accordingly, we ask you to immediately contact our security team via email at [email protected] upon receiving a suspicious request.