Register
Recruit Create CV

Spark Data Engineer Jobs

Spark Lead Jobs
By NLB Services At Irving, TX, United States
· Strong hands-on experience in shell/python scripting language and good understanding of Linux/Unix.
· Good to have knowledge on Sensu
· Hands on experience in Jenkins , RLM, Ansible
· Good to have knowledge and understanding of K8s.
Location: Irving Tx(Day one onsite role)
· Strong understanding of SRE concept and practices with automation implementation.
Spark Studio Guide Jobs
By Lighthouse International: an Acton Academy At St. Charles County, MO, United States

Qualifications: -Montessori training/certification (early childhood / elementary) preferred -Experience managing mixed-aged groups of children -Curious with a lifelong love of learning -Excellent ...

Data Engineer- Spark Java
By LTI - Larsen & Toubro Infotech At United States
• Strong experience in ETL development with Java & Spark
• Strong experience with Redshift, AWS S3, SQL
• Experience in developing microservices
• Hands on experience with AWS services
• Should have experience to lead the delivery for distributed teams
• Providing Support and reengineer an existing ETL process
?Spark Engineer Jobs
By TanPro ITCorp At , Remote
Data Formats Experience – Parquet, CSV etc.
Azure, GCP knowledge is a plus
Big Data Hadoop, Spark, PySpark
Hands on Programming – Java, Scala, Python
AWS Cloud –S3, EFS, MSK, ECS, EMR,
Distributed Computing constructs – Joins,

Are you a data engineer looking to join a cutting-edge team? We are looking for a talented individual to join our team and help us build the next generation of data-driven products. You will be responsible for designing and developing data pipelines, ETL processes, and data models to support our data-driven initiatives. You will also be responsible for developing and maintaining data warehouses and data lakes. If you have a passion for data engineering and a desire to work with the latest technologies, then this is the job for you!

Overview A Spark Data Engineer is responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes. They are responsible for creating and managing data models, ETL processes, and data analysis. They must have a strong understanding of data engineering principles and be able to work with a variety of data sources. Detailed Job Description A Spark Data Engineer is responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes. They must have a strong understanding of data engineering principles and be able to work with a variety of data sources. They must be able to design and develop ETL processes, data models, and data analysis. They must be able to create and maintain data pipelines and data lakes. They must be able to work with a variety of data sources, including structured, semi-structured, and unstructured data. They must be able to work with a variety of technologies, including Apache Spark, Hadoop, and other big data technologies. Job Skills Required
• Expertise in Apache Spark, Hadoop, and other big data technologies
• Knowledge of data engineering principles and best practices
• Ability to design and develop ETL processes, data models, and data analysis
• Ability to create and maintain data pipelines and data lakes
• Ability to work with a variety of data sources, including structured, semi-structured, and unstructured data
• Knowledge of data security and privacy principles
• Knowledge of data warehousing and data lake architectures
• Knowledge of data visualization tools
• Ability to work with a variety of programming languages, including Java, Python, and Scala
Job Qualifications
• Bachelor’s degree in Computer Science, Information Technology, or related field
• 5+ years of experience in data engineering
• Experience with Apache Spark, Hadoop, and other big data technologies
• Experience with ETL processes, data models, and data analysis
• Experience with data pipelines and data lakes
• Experience with data security and privacy principles
• Experience with data warehousing and data lake architectures
• Experience with data visualization tools
• Experience with programming languages, including Java, Python, and Scala
Job Knowledge
• Knowledge of data engineering principles and best practices
• Knowledge of data security and privacy principles
• Knowledge of data warehousing and data lake architectures
• Knowledge of data visualization tools
• Knowledge of programming languages