Register
Recruit Create CV
Unfortunately, this job posting is expired.
Don't worry, we can still help! Below, please find related information to help you with your job search.
Related keywords
Some similar recruitments
Sap Data Quality Analyst
Recruited by Endeavor Consulting Group, LLC 9 months ago Address Philadelphia, PA, United States
Data Engineer With Python
Recruited by Zirlen Technologies Inc., 10 months ago Address Pittsburgh, PA, United States
Aws Data Engineer Jobs
Recruited by Capgemini 1 year ago Address Malvern, PA, United States

Aws Data Migration Engineer

Company

Algonomy
Address , Philadelphia, Pa
Employment type
Salary
Expires 2023-07-18
Posted at 11 months ago
Job Description

Description of the Project

To integrate complex real-world Customer TV and Digital Ad viewing data to perform pre- campaign planning and post-campaigns performance measurements using Big Data Platform (Databricks, Glue, EMR, Step-functions, Lambda, PySpark and other AWS services to support existing workloads, Automate and monitor and based on requirement develop an elastic, scalable, high performance and cost-effective solution in collaboration with cross functional teams.

Key Goals Specified by Manthan / Client(s)

  • Responsible for support, migration, automation and monitoring of data pipelines to ingest data, integrate data from multiple data sources (On-Premise & Cloud) and create aggregated data sets for reporting needs and appropriate notifications.
  • Position is responsible for the support, migration, automation and monitoring of existing data pipelines and based on new requirements, design, develop, test, and deploy the Big Data Analytics solutions on cloud (AWS) and Databricks.
  • Dive into large, noisy, and complex real-world customer TV and Digital Ad viewing data to do pre-campaign planning and post campaigns performance measurement using Big data Platform (Databricks, PySpark, Glue, EMR).
  • Monitoring of data pipelines with PySpark, AWS services
  • 8+ years of overall software development
  • Requirement gathering, design and Support, Migration, Automation
  • Collaborate with key stake holders and translate business requirements to technical requirements & implement solutions.
  • Experience on Big Data Technologies, Hadoop Eco system and Technologies with experience programming in Scala, PySpark and Python
Location States ( NJ, NY, MA, CT, NC, PA preferred)