Senior Data Engineer - Aws

Who We Are:

The Data Sherpas are highly skilled and motivated engineers that help our clients at every phase of their cloud journey. If it touches the cloud, involves data, or lives as an application, we have either worked on it or have the skills and expertise to accomplish it.

What We Are Looking For:

We are looking for an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for helping define and build robust data engineering solutions on the cloud, specifically on Amazon Web Services (AWS). You should have excellent technical skills in developing data pipelines and ETL and experience supporting data analysis. Additionally, you should have experience working directly with business stakeholders in driving their needs into actionable tasks that lead to tangible results.

Data Engineering: The ideal candidate should have extensive experience developing end-to-end data engineering solutions across multiple datasets and environments. Furthermore, they should deeply understand database concepts such as normalization and denormalization, indexing strategies, performance tuning, etc.

AWS: This role requires significant hands-on experience with Amazon Web Services (AWS) technologies, including but not limited to EC2, S3, Lambda functions, Glue jobs, Redshift clusters, and more. They should be able to set up secure IAM roles and enforce best practices when dealing with sensitive data.

Team Lead: The candidate should have experience leading medium size teams or projects within a data engineering space. This includes setting up project plans & timelines, assigning tasks & managing resources accordingly while maintaining quality standards throughout execution.

Snowflake: The right candidate must have had exposure working with Snowflake both architecturally and programmatically (SQL/Python/JavaScript). They should understand how to create databases/schemas/tables/views from scratch following best practices & security protocols established by the company or client.

Airflow: The right candidate must be comfortable setting up DAGs from scratch & troubleshooting any issues that may arise during the development or deployment stages. In addition, expertise in writing custom plugins & extensions would be highly advantageous given the complexity of some data engineering processes we employ using the Airflow technology stack.

What You'll Do:

• You will be expected to become familiar with the existing AWS infrastructure and utilization. You should also be able to identify areas where your expertise can be used to improve processes or expand capabilities.
• You are expected to be able to implement significant changes that improve data operations' efficiency while maintaining high-security levels.
• You will effectively lead a team of data engineers through projects. They should comprehensively understand The Data Sherpas' processes and environment, as well as all relevant technologies and established processes.
• You will lead more complex projects that combine AWS services and custom applications built using Snowflake and Airflow technologies. This could include creating custom APIs or web applications that use machine learning models powered by datasets stored in Snowflake databases.

We cannot work with third-party agencies at this time. Resumes submitted via unapproved agencies will be automatically rejected.