Lead Data Engineer Jobs
By Capital One At Richmond, VA, United States
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
7+ years of experience in application development including Python, SQL, or Scala
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
4+ years experience with Distributed data/computing tools (EMR, Kafka, or Spark)
Data Engineer Jobs
By Zoox At , Foster City, Ca $143,000 - $300,000 a year
Experience operating a workflow manager such as Airflow
Experience designing and building complex data infrastructure at scale
Exceptional Python or Scala skills
Advanced SQL and data warehousing experience
Experience with large scale streaming platforms (e.g. Kafka, Kinesis), processing frameworks (e.g. Spark, Hadoop) and storage engines (e.g. HDFS, HBase)
Designing, building, and maintaining the infrastructure that transforms autonomous vehicle data at scale to support analytics throughout the company

Are you a data engineer looking to take your career to the next level? We are looking for a Lead Data Engineer to join our team and help us build the future of data-driven decision making. You will be responsible for designing, developing, and maintaining data pipelines and architectures to support our data-driven initiatives. If you have a passion for data engineering and want to be a part of a fast-paced, innovative team, then this is the job for you!

A Lead Data Engineer is responsible for designing, developing, and maintaining data systems and pipelines. They are also responsible for ensuring the accuracy and integrity of data, as well as developing and implementing data security measures.

What is Lead Data Engineer Skills Required?

• Expertise in data engineering, data warehousing, and data modeling
• Knowledge of database management systems, such as Oracle, SQL Server, and MySQL
• Experience with big data technologies, such as Hadoop, Spark, and NoSQL
• Proficiency in programming languages, such as Python, Java, and C++
• Ability to develop and maintain data pipelines
• Knowledge of data visualization tools, such as Tableau and Power BI
• Excellent problem-solving and analytical skills
• Strong communication and organizational skills

What is Lead Data Engineer Qualifications?

• Bachelor’s degree in Computer Science, Information Systems, or a related field
• 5+ years of experience in data engineering
• Experience with cloud-based data solutions, such as AWS and Azure
• Knowledge of data governance and security best practices

What is Lead Data Engineer Knowledge?

• Knowledge of data warehousing and ETL processes
• Understanding of data mining and analytics techniques
• Familiarity with data quality assurance and data cleansing
• Understanding