Azure Data Engineer Jobs

Top 3 Skills:

1. Python - PySpark

2. SQL

3. Terraform – Azure data infrastructure

The Work:

• Lead development initiatives and team from technical perspective by mentoring team members and contributing towards code base
• Acts as strong advocate for a culture of quality and pushing the boundaries of platform
• Be the subject matter expert for data, pipeline design, architecture, and other data engineering technologies for the team
• Work with the latest and greatest technologies in the Microsoft cloud stack including Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc
• Owns the technical vision and development of a domain or capability
• Leads team to utilize new frameworks/technologies to improve an existing process or service. Brings fresh perspective based on research and latest industry standards.
• High-level and low-level design of real time and batch system interfaces and data enrichment pipelines in a cloud-native data ecosystem
• Promoting and enforcing design and development standards and best practices
• Help to define the technical direction of the team and drive the actual architecture/design/implementations to enhance an ever-expanding data platform, that supports business process needs for internal and external integration via APIs, data models, self-serve reporting solutions, and interactive querying

The Skills:

• 5+ years of strong data engineering experience, 2+ years of Cloud Data Engineering experience
• Experience with developing and architecting data ingestion models, ETL jobs, and alerting to maintain high availability and data integrity
• Experience working with cloud technologies such as Azure (Preferred), AWS or GCP
• Bachelor\'s degree in Computer Science, Information Systems, similar technical field of study or equivalent practical experience
• Strong knowledge of DevOps pipeline creation, maturity, and operations
• Experience with development of test automation framework for unit, functional and integration tests around data pipelines
• A results-oriented individual who can make a difference; a person who takes initiative, makes things happen, & has a “can do” attitude
• Strong requirements gathering and design abilities
• Solid understanding of real-time & batch data processing, data pipelines, transformation and modeling using traditional and distributed systems
• Hands on experience with SQL and Python or other object-oriented programming language

Mandatory Skills:

• Candidates need to able to convert as Ally employee without any sponsorship from Ally as an employer.
• Experience with Python & SQL.
• Experience with Azure cloud stack and especially with data services like Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure function, Service Bus, etc

Desired Skills:

• Local Charlotte, NC candidates preferred.
• Hybrid working 3 days in office is preferred.