Register
Recruit Create CV

Pyspark Data Engineer Jobs in Clermont, Ohio

Data Engineer Jobs
By RADcube At , Cincinnati
Bachelor's degree in Computer Science/Information Systems or equivalent combination of education and experience.
Knowledge of application and data security concepts, best practices, and common vulnerabilities.
Responsible for design, Development, and Support of data solutions, APIs, tools, and processes to enable rapid delivery of business capabilities.
Manage and prioritize multiple assignments.
Act as a technical Expert addressing problems related to system and application design, performance, integration, security, etc.
Work with developers to Build CI/CD pipelines, Self-service Build tools, and automated deployment processes.
Data Engineer Jobs
By Uline At , Pleasant Prairie, 53158
Be responsible for the full life cycle of development, from requirements gathering through ETL coding and report/dashboard design and creation.
Work with business users to establish reporting and analytic requirements.
Translate business requirements into ETL and report specifications.
Provide technical and business knowledge support to the team.
Excellent knowledge of data design, SQL and data warehousing.
Knowledge of IBM Cognos BI a plus.
Data Engineer Jobs
By The Wendy's Company At Dublin, OH, United States
Minimum 2 years experience with software implementation and data management
Support the key stakeholder for change management and training shepherding new features to production
Manage existing implementations and execute system configuration changes
Participate in requirement gathering, story scoping and project timeline efforts to deliver solutions in a timely manner
Education: Bachelors Degree , required
Working knowledge of cloud technology tools (Google Cloud preferred) e.g. Looker, Python, Snaplogic, preferred
Data Engineer Jobs
By One IT Corp At Cincinnati, OH, United States
MINIMUM KNOWLEDGE, SKILLS AND ABILITIES REQUIRED:
Assist with problem resolution for end users and customers, including incident & problem management
Understanding of data management and info security best practices
Provide technical knowledge, leadership and collaboration as an ETL developer & designer
Participate in communities of practice by contributing to and following standards, test driven development, reviewing others code, and sharing knowledge
Maintain appropriate controls and documentation to ensure compliance of audit requirements
Data Engineer Jobs
By eBay Inc. At , Amsterdam, Ny
3+ years of software development experience
Design and build high-performing, reliable solutions for high-throughput data systems using a variety of third-party and eBay internal libraries and frameworks
Work with other product teams across eBay
Balance strong ownership and teamwork
Research, innovate, deliver and grow
Bachelor’s or Master degree in Computer Science or related field
Data Engineer Jobs
By The RiverStone Group At , Manchester, 03101, Nh
Facilitates key business and technical stakeholder discussions to formulate business requirements for new or enhanced data integrations.
Experience implementing Modern Data Processing Architectures leveraging Microsoft Technologies
Experience in designing and developing ETL data pipelines leveraging SQL Server Integration Services, Microsoft Azure Data Factory or similar integration technology
Experience developing data integration pipelines leveraging restful API services and queuing technologies a huge plus
Experience in designing and building dimensional data models using a Data Warehouse Development Methodology framework such as Kimball or Inman
Database development experience with Relational or MPP/distributed systems such as SQL Server/Oracle/Spark/Hadoop preferred and Big Data architectures
Data Engineer Jobs
By Veterans United Home Loans At , Columbia, Mo
Ensure deliverables adhere to defined data standards, data models and definitions, and actively contribute to data governance/master data management initiatives.
Design and implement data pipelines, data marts, data warehouses, and other data products to meet functional and non-functional business requirements.
Maintain project documents, templates, document specifications, and other reusable knowledge assets.
Strong communication skills (written and verbal).
Quantitative and analytical decision-making skills.
2+ years of experience in developing complex SQL queries including windowing functions, transaction handling, dynamic SQL, etc.
Data & Ml Engineer Jobs
By Sogeti At Columbus, Ohio Metropolitan Area, United States
Min 7+ years' IT platform implementation experience
Experience with analytic solutions applied to the Marketing or Risk needs of enterprises
Experience with one or more relevant tools (Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis)
Experience developing software code in one or more programming languages (Java, JavaScript, Python, etc.)
Engage in a wide variety of projects and provide collective experience from across the AWS customer base
Basic understanding of Machine Learning fundamentals
Data Engineer Jobs
By Wawa At , Wawa, Pa
Basic project management skills required
Understand complex business requirements and propose end to end and simplified enterprise information architecture solutions.
Work closely with Analytics team and implement their self-service and analytics requirements.
Manage all activities centered on obtaining data and loading into a data lake environment.
Balance business requirements with technical feasibility and set expectations on new projects. Recommend changes in development, maintenance and system standards.
5+ years database, data integration experience
Data Engineer Jobs
By Absolute Business Solutions Corp At , Fayetteville, 28314, Nc
Coordinate with Analytics teams and Apps teams to support new requirements
5 years of experience in data engineering (ETL/ELT, Python, etc)
Demonstrated experience with Airflow and Trino
Knowledge of ABAC and Immuta a big plus
Excellent written and verbal communication skills.
Career Development –$5,250 Annually Towards Education and Training
Data Engineer Jobs
By Citadel Securities At , Miami, Fl
Demonstrated experience driving meaningful business outcomes through data engineering
Good analytical and quantitative abilities
Demonstrated ability to quickly learn new technologies and skills
Experience with data manipulation and query design and optimization
Strong coding skills: proficiency in Python, SQL DBs, Cloud, schedulers, containers, CI/CD, software packaging
Education: BS degree in Computer Science, Mathematics, or related Computer Engineering or Science curriculum
Data Engineer Jobs
By Mass General Brigham(PHS) At , Somerville, 02145, Ma
Develop and enforce change management and versioning processes for code promotion.
Knowledge of agile principles and experience working within an agile team is preferred
Advanced SQL DML skills required, with comparable experience in writing data functions (e.g. TSQL procs, Snowflake UDFs, etc).
Works with cross-functional teams to understand functional product requirements and deliver on strategic data and analytics initiatives
Other duties and responsibilities as assigned
Ability to manage multiple projects simultaneously, set priorities, and collaborate with team members and others throughout the organization
Data Engineer Jobs
By Niyama Global LLC At New Brunswick, NJ, United States

Data Engineer New Brunswick NJ 08903 Duration: 12 Months Hrs/Wk (Maximum of 40):40.00 Level: Junior (0-3 Yrs.) We are seeking a talented and highly motivated data engineer to join the ...

Data Engineer Jobs
By Kane Partners LLC At Warminster, PA, United States
Have a knowledge and understanding of statistical analysis, machine learning concepts, Python, and Cloud services including Azure
· Work with the team of Data Scientists for software optimization using Machine learning and predictive analytics
· Work directly with architects and product owners on the delivery of data pipelines and platforms
YOU MUST BE A SELF-STARTER
· Strong attention to detail, with a quality-focused mindset
· Effectively communicate ideas and data verbally and in writing
Data Engineer Jobs
By ConnectedX Inc. At Plano, TX, United States

Please find the below requirement details

Data Engineer 4696 Jobs
By MetroStar At Fort Huachuca, AZ, United States
5+ years of professional experience building end-to-end data pipelines.
Strong SQL (Presto, Spark SQL, etc) skills.
Experience solving problems across the data stack (Data Infrastructure, Analytics, and Visualization platforms).
Don’t meet every single requirement?
Help define and build key datasets across functional areas. Lead the evolution of these datasets as use cases grow.
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data repository.
Data Engineer Jobs
By Sudina Search At Frederick, MD, United States

Are you passionate about data and ready to take your career to the next level? Join my clients team and be part of their exciting journey to expand their Enterprise Data Warehouse and cloud-based ...

Data Engineer Jobs
By GVD Systems LLC At Jacksonville, FL, United States
• Responsible for providing day to day support, troubleshooting and incident management and resolution.
We only consider US experience!
STRONG AZURE EXPERIENCE IS A MUST!
• Responsible for analyzing data to validate business domains and requirements.
• Responsible for data profiling and ensuring data quality requirements are accurate and complete.
• Excellent analytical, problem-solving, and decision-making skills, leveraging both logic and creativity.
Data Engineer Jobs
By RedStream Technology At Atlanta Metropolitan Area, United States
3 - 5 years of work experience in managing, supporting & engineering of Cloud Analytical Products offered by AWS & Azure.
Relevant AWS, Azure certifications would be a big plus point. Strong problem solving and troubleshooting skills
Strong process management background, in developing and optimizing processes
Strong Technical knowledge of Data Visualization Tools like Tableau, Power BI, Domo.
Solid interpersonal and communication skills
The ability to work both independently and in project teams in a remote team setting
Data Engineer Jobs
By Intellibee At , Mountain View
Solid understanding of Spark including performance tuning.
Solid understanding of the AWS Platform
Ability to work with Business and technical stake holders independently with minimal guidance - Must have
Strong written and verbal communication and ability to articulate data with the business stake holders - Must have
Location: Mountain View, California (Hybrid, 2 days a week onsite)
Data Engineer Jobs
By iHeartMedia, Inc. At , New York, 10019

iHeartMedia Current employees and contingent workers click here to apply and search by the Job Posting Title. The audio revolution is here – and iHeart is leading it! iHeartMedia, the number one ...

Data Engineer Jobs
By The Proven Method At Georgia, United States
3 years of Professional Development experience
Primary skills needed are Java, Python, and SQL or some combination of these Technologies
Must have a minimum of 4 years of professional Python Experience
Experience with Docker, MLFlow and AirFlow
Analytics experience to aggregate data and visualize as needed.
CORP TO CORP and 3rd Party CANDIDATES WILL NOT BE CONSIDERED.
Data Engineer Jobs
By Chevron At , Houston $112,000 - $200,000 a year
We offer a hybrid work model - work remotely from home 2-3 days a week
Understanding the business use of data and the stakeholders requirements to support work processes and strategic business objectives.
Experiences in coding for analytics (batch and real time data processing), optimization for performance, reusability, and cost effectiveness
We offer alternative work schedules including 9/80 (work 9-hour days, with every other Friday off)
Join Chevron IT. Lend us your skills and enjoy a great career with Chevron.
Responsibilities for this position may include but are not limited to:
Anr Data Engineer - Juniper
By Alaska Northstar Resources, LLC At , Remote $110,000 - $140,000 a year
Experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP).
Industry experience coding commercial software and a passion for solving complex problems.
Experience with Informix and Data Stage
Candidate must have 5+ years experience with the following:
Lead and architect migration of data environments with performance and reliability.
Assess and understand the ETL jobs, workflows, BI tools, and reports.
Data Engineer Jobs
By ADT At , Boca Raton, 33431 $73,066 - $146,131 a year
Overseeing the collection, storage, management, quality and protection of data.
The salary range for this role is $73,066-$146,131 and is based on experience and qualifications.
Knowledge of relevant applications, big data solutions and tools.
Thorough understanding of the business and data strategy.
Designing and implementing data strategies and systems.
Implementing data privacy policies and complying with data projection regulations.
Data Engineer Jobs
By CoStar Group At , San Diego, 92122
This position is located in La Jolla and offers 2 days remote per week.
Architect: Use your experience to drive the design of highly performant and highly available data solutions.
3+ years of SQL Server engineering experience as well as ETL/data pipeline (SSIS) engineering experience
Ability to analyze technical requirements and design new architectures, data models, and ETL strategies
Experience with AWS SQL and NoSQL databases is a plus
Experience with integration products like Glue, Lambda, AWS Data Pipeline, and/or Database migration services is a plus
Data Engineer Jobs
By Harnham At Buffalo-Niagara Falls Area, United States
Experience with data pipeline and workflow management tools
Assemble large, complex data sets that meet functional / non-functional business requirements.
Experience with Azure cloud services
4+ years of SQL experience (No-SQL experience is a plus)
Experience working with structured and semi structured data at the enterprise scale.
Create and maintain optimal data pipeline architecture.
Data Engineer Jobs
By State of Wisconsin At , Green Bay $47.89 - $55.95 an hour
Experience evaluating and consulting on data management and data warehouse (or similar tool or technology) options.
Experience providing technical service or consultation to stakeholders regarding data strategy or data management.
Advanced education, training, or certification in computer science or related field.
Experience designing, developing, and managing relational databases.
Formal training or experience using SQL and Oracle.
Experience in data extract, transformation, and extract transform load techniques and execution.
Data Engineer, Service Jobs
By Tesla At , Austin
Working knowledge of data management software like Airflow, or other ETL tools a plus.
Research and keep abreast of rapidly evolving data requirements, ensuring necessary system and process changes are implemented to meet these requirements.
Continuously improve SQL and python skills, helping you automate repetitive work and multiply yourself
2+ years of prior experience Data Engineer.
Experience with Tableau or any visualization tool, Data Warehousing, Data Modeling
Strong experience with relational databases like SQL Server, MySQL and Vertica. NoSQL databases experience is a plus
Data Engineer Jobs
By Capgemini At , Hartford
8+ years of experience in a data engineering function
Experience accessing and retrieving data from disparate large data sources, by creating and tuning SQL queries. Experienced in AWS Solution
Ability to analyze data sources and provide technical solutions. Strong exploratory and problem solving skills to check for data quality issues.
Understanding of data modeling concepts, data warehousing tools and databases (e.g. Talend , Python,, Spark/PySpark, ETL, Big Data, ORACLE)
Determine business recommendations and translate into actionable steps
Ability to work both independently and in a team environment with internal customers
Data Engineer Jobs
By ARK Solutions At , Las Vegas

Scope of Tasks: Must have minimum 8+ years of experience with least 4 project Implementation in SAP BODS (Data Services) ETL tool & migration of SuccessFactors or FI objects. Excellent ...

Are you a data engineer looking to work with cutting-edge technologies? Join our team and help us build the future of data engineering with Apache Spark and Pyspark! We are looking for a talented engineer to help us develop and maintain our data pipelines and ETL processes. You will have the opportunity to work with a wide range of data sources and technologies, and to create innovative solutions to complex data problems. If you are passionate about data engineering and want to make a real impact, this is the job for you!

A Pyspark Data Engineer is responsible for developing, maintaining, and optimizing data pipelines and architectures. They are responsible for creating and maintaining data models, data warehouses, and data lakes. They must be able to work with large datasets and be able to analyze and interpret data.

What is Pyspark Data Engineer Skills Required?

• Expertise in Python, Pyspark, and SQL
• Knowledge of data warehousing and data lake architectures
• Experience with big data technologies such as Hadoop, Spark, and Kafka
• Knowledge of data modeling, ETL, and data analysis
• Ability to work with large datasets and analyze data
• Knowledge of cloud computing and distributed systems
• Ability to write efficient and optimized code
• Knowledge of data security and privacy

What is Pyspark Data Engineer Qualifications?

• Bachelor’s degree in Computer Science, Information Technology, or related field
• 5+ years of experience in data engineering
• Experience with data warehousing and data lake architectures
• Experience with big data technologies such as Hadoop, Spark, and Kafka
• Knowledge of data modeling, ETL, and data analysis
• Knowledge of cloud computing and distributed systems
• Ability to write efficient and optimized code
• Knowledge of data security and privacy
Know