Register
Recruit Create CV

Pyspark Data Engineer Jobs in Bucks, Pennsylvania

Data Engineer Jobs
By Kane Partners LLC At Warminster, PA, United States
Have a knowledge and understanding of statistical analysis, machine learning concepts, Python, and Cloud services including Azure
· Work with the team of Data Scientists for software optimization using Machine learning and predictive analytics
· Work directly with architects and product owners on the delivery of data pipelines and platforms
YOU MUST BE A SELF-STARTER
· Strong attention to detail, with a quality-focused mindset
· Effectively communicate ideas and data verbally and in writing
Data Engineer Jobs
By INFI IT LLC At Langhorne, PA, United States
Assemble large, complex data sets that meet functional / non-functional business requirements.
Create and maintain optimal data pipeline architecture,
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Work with data and analytics experts to strive for greater functionality in our data systems.
Looking for W2 Fulltime Opportunity.
Data Engineer Jobs
By Kane Partners LLC At Chalfont, PA, United States
· Some experience in Data Engineering or Analysis
· Experience with Python, SQLServer, Cloud services
· A pro-active data driven problem-solver
· Detail-oriented scientist that prefers minimal supervision
· Understands a communicates economic value propositions
· Enthusiastic learner and communicator
Data Engineer Jobs
By Jobot At Malvern, PA, United States
Proficient in BI, PowerBI, dashboarding, Bioinformatics, and biological data management.
Work closely with the Bioinformatics team to manage and analyze biological data, providing insights to support decision-making processes.
Create and manage PowerBI dashboards, providing visual insights into complex data sets.
Minimum of 3 years of experience in a data engineering role within the technology industry.
Proven experience with ETL pipelines, data engineering, AWS, data centers, and data pipelines.
Strong knowledge of Python, data analysis, machine learning, data mining, data visualization, and data warehousing.
Data Engineer Jobs
By Fishawack Health At Pennsylvania, United States
Experience with marketing analytics tools such as Google Analytics, Google Campaign Manager, and Facebook Ads
Proficient with Git version control systems and release/change management processes
Collaborates with cross-functional stakeholders such as Data Scientists, Business Analysts, Project Managers, Media Operations and Quality Assurance to achieve expected results
Experience in a digital marketing agency preferred
4 years of experience in data engineering with strong emphasis on complex SQL and DB design
2 years of experience developing highly custom, automated ETL procedures and data pipelines
Data Engineer Jobs
By Search Tactics LLC At Philadelphia, PA, United States

Mandatory Skills: Python, ETL, SQL, Jenkins

Location: Philadelphia, PA, Day 1 Onsite

Data Engineer Jobs
By The Kraft Heinz Company At United, PA, United States

Office Collaboration & Hybrid Work Environment

Data Engineer Jobs
By Deloitte At Glen Mills, PA, United States
Participate in team problem solving efforts and offer ideas to solve client issues
Provide experience and development for a Deloitte product in development
Associates degree in Accounting, Information Technology/Systems, Business, Finance or another Business-related field
Must have 2+ years of experience in Apache Spark to build and maintain ETL pipelines
Identify opportunities for efficiencies in work process and innovative approaches to completing scope of work
Maintain responsibility for completion and accuracy of work products
Data Engineer Jobs
By Intellyk Inc. At Pittsburgh, PA, United States
Experience using one or more programming languages (Python, R, C++, Java, MATLAB, etc.) and manipulating data using SQL and Pandas
Excellent written and verbal communication skills for coordination across teams
Nice to have knowledge of advanced statistical techniques and concepts (regression, time series analysis, statistical tests, etc.)
Bachelor/Master/PhD's Degree in a quantitative field (computer science, financial engineering, mathematics, data science or engineering)
Understanding of design, development and implementation of mathematical, financial risk and ML models
This is what we are looking for.
Data Engineer Jobs
By Veeva Systems At Fort Washington, PA, United States
Experience working with ETL, Automation, and Workflow management tools like Airflow, Informatica, Nifi, Talend, etc.
3+ years of experience in Data Engineering and/or Analytics
3+ years of experience working with SQL
1+ years of experience with Python and Unix scripting
Experience using data visualization tools like Tableau
Investigate data issues coming from stakeholders, both external and internal
Data Engineer Jobs
By Sun Technologies At King of Prussia, PA, United States
Programming Skills: Should have a strong foundation in programming languages like Python, RUST, Java, and Scala.
Database Skills: Should be proficient in SQL and know about NoSQL databases such as Cassandra, MongoDB, and HBase.
Big Data: Knowledge of distributed computing technologies like Hive, Hadoop, and Spark, is becoming increasingly important for data engineers.
Data Warehousing: Understanding the concepts of data warehousing, including ETL (Extract, Transform, Load) processes and data modeling is essential.
Data Integration: Should be able to integrate data from various sources, such as web services, APIs, and file systems.
Cloud Computing: Familiarity with cloud-based storage and computing platforms such as Azure, AWS, and GCP is crucial.
Data Engineer Jobs
By Niyama Global LLC At New Brunswick, NJ, United States

Data Engineer New Brunswick NJ 08903 Duration: 12 Months Hrs/Wk (Maximum of 40):40.00 Level: Junior (0-3 Yrs.) We are seeking a talented and highly motivated data engineer to join the ...

Data Engineer Jobs
By ConnectedX Inc. At Plano, TX, United States

Please find the below requirement details

Data Engineer 4696 Jobs
By MetroStar At Fort Huachuca, AZ, United States
5+ years of professional experience building end-to-end data pipelines.
Strong SQL (Presto, Spark SQL, etc) skills.
Experience solving problems across the data stack (Data Infrastructure, Analytics, and Visualization platforms).
Don’t meet every single requirement?
Help define and build key datasets across functional areas. Lead the evolution of these datasets as use cases grow.
Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data repository.
Data Engineer Jobs
By Sudina Search At Frederick, MD, United States

Are you passionate about data and ready to take your career to the next level? Join my clients team and be part of their exciting journey to expand their Enterprise Data Warehouse and cloud-based ...

Data Engineer Jobs
By GVD Systems LLC At Jacksonville, FL, United States
• Responsible for providing day to day support, troubleshooting and incident management and resolution.
We only consider US experience!
STRONG AZURE EXPERIENCE IS A MUST!
• Responsible for analyzing data to validate business domains and requirements.
• Responsible for data profiling and ensuring data quality requirements are accurate and complete.
• Excellent analytical, problem-solving, and decision-making skills, leveraging both logic and creativity.
Data Engineer Jobs
By RedStream Technology At Atlanta Metropolitan Area, United States
3 - 5 years of work experience in managing, supporting & engineering of Cloud Analytical Products offered by AWS & Azure.
Relevant AWS, Azure certifications would be a big plus point. Strong problem solving and troubleshooting skills
Strong process management background, in developing and optimizing processes
Strong Technical knowledge of Data Visualization Tools like Tableau, Power BI, Domo.
Solid interpersonal and communication skills
The ability to work both independently and in project teams in a remote team setting
Data Engineer Jobs
By Intellibee At , Mountain View
Solid understanding of Spark including performance tuning.
Solid understanding of the AWS Platform
Ability to work with Business and technical stake holders independently with minimal guidance - Must have
Strong written and verbal communication and ability to articulate data with the business stake holders - Must have
Location: Mountain View, California (Hybrid, 2 days a week onsite)
Data Engineer Jobs
By iHeartMedia, Inc. At , New York, 10019

iHeartMedia Current employees and contingent workers click here to apply and search by the Job Posting Title. The audio revolution is here – and iHeart is leading it! iHeartMedia, the number one ...

Data Engineer Jobs
By The Proven Method At Georgia, United States
3 years of Professional Development experience
Primary skills needed are Java, Python, and SQL or some combination of these Technologies
Must have a minimum of 4 years of professional Python Experience
Experience with Docker, MLFlow and AirFlow
Analytics experience to aggregate data and visualize as needed.
CORP TO CORP and 3rd Party CANDIDATES WILL NOT BE CONSIDERED.
Data Engineer Jobs
By Chevron At , Houston $112,000 - $200,000 a year
We offer a hybrid work model - work remotely from home 2-3 days a week
Understanding the business use of data and the stakeholders requirements to support work processes and strategic business objectives.
Experiences in coding for analytics (batch and real time data processing), optimization for performance, reusability, and cost effectiveness
We offer alternative work schedules including 9/80 (work 9-hour days, with every other Friday off)
Join Chevron IT. Lend us your skills and enjoy a great career with Chevron.
Responsibilities for this position may include but are not limited to:
Anr Data Engineer - Juniper
By Alaska Northstar Resources, LLC At , Remote $110,000 - $140,000 a year
Experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP).
Industry experience coding commercial software and a passion for solving complex problems.
Experience with Informix and Data Stage
Candidate must have 5+ years experience with the following:
Lead and architect migration of data environments with performance and reliability.
Assess and understand the ETL jobs, workflows, BI tools, and reports.
Data Engineer Jobs
By RADcube At , Cincinnati
Bachelor's degree in Computer Science/Information Systems or equivalent combination of education and experience.
Knowledge of application and data security concepts, best practices, and common vulnerabilities.
Responsible for design, Development, and Support of data solutions, APIs, tools, and processes to enable rapid delivery of business capabilities.
Manage and prioritize multiple assignments.
Act as a technical Expert addressing problems related to system and application design, performance, integration, security, etc.
Work with developers to Build CI/CD pipelines, Self-service Build tools, and automated deployment processes.
Data Engineer Jobs
By ADT At , Boca Raton, 33431 $73,066 - $146,131 a year
Overseeing the collection, storage, management, quality and protection of data.
The salary range for this role is $73,066-$146,131 and is based on experience and qualifications.
Knowledge of relevant applications, big data solutions and tools.
Thorough understanding of the business and data strategy.
Designing and implementing data strategies and systems.
Implementing data privacy policies and complying with data projection regulations.
Data Engineer Jobs
By CoStar Group At , San Diego, 92122
This position is located in La Jolla and offers 2 days remote per week.
Architect: Use your experience to drive the design of highly performant and highly available data solutions.
3+ years of SQL Server engineering experience as well as ETL/data pipeline (SSIS) engineering experience
Ability to analyze technical requirements and design new architectures, data models, and ETL strategies
Experience with AWS SQL and NoSQL databases is a plus
Experience with integration products like Glue, Lambda, AWS Data Pipeline, and/or Database migration services is a plus
Data Engineer Jobs
By Harnham At Buffalo-Niagara Falls Area, United States
Experience with data pipeline and workflow management tools
Assemble large, complex data sets that meet functional / non-functional business requirements.
Experience with Azure cloud services
4+ years of SQL experience (No-SQL experience is a plus)
Experience working with structured and semi structured data at the enterprise scale.
Create and maintain optimal data pipeline architecture.
Data Engineer Jobs
By State of Wisconsin At , Green Bay $47.89 - $55.95 an hour
Experience evaluating and consulting on data management and data warehouse (or similar tool or technology) options.
Experience providing technical service or consultation to stakeholders regarding data strategy or data management.
Advanced education, training, or certification in computer science or related field.
Experience designing, developing, and managing relational databases.
Formal training or experience using SQL and Oracle.
Experience in data extract, transformation, and extract transform load techniques and execution.
Data Engineer, Service Jobs
By Tesla At , Austin
Working knowledge of data management software like Airflow, or other ETL tools a plus.
Research and keep abreast of rapidly evolving data requirements, ensuring necessary system and process changes are implemented to meet these requirements.
Continuously improve SQL and python skills, helping you automate repetitive work and multiply yourself
2+ years of prior experience Data Engineer.
Experience with Tableau or any visualization tool, Data Warehousing, Data Modeling
Strong experience with relational databases like SQL Server, MySQL and Vertica. NoSQL databases experience is a plus

Are you a data engineer looking to work with cutting-edge technologies? Join our team and help us build the future of data engineering with Apache Spark and Pyspark! We are looking for a talented engineer to help us develop and maintain our data pipelines and ETL processes. You will have the opportunity to work with a wide range of data sources and technologies, and to create innovative solutions to complex data problems. If you are passionate about data engineering and want to make a real impact, this is the job for you!

A Pyspark Data Engineer is responsible for developing, maintaining, and optimizing data pipelines and architectures. They are responsible for creating and maintaining data models, data warehouses, and data lakes. They must be able to work with large datasets and be able to analyze and interpret data.

What is Pyspark Data Engineer Skills Required?

• Expertise in Python, Pyspark, and SQL
• Knowledge of data warehousing and data lake architectures
• Experience with big data technologies such as Hadoop, Spark, and Kafka
• Knowledge of data modeling, ETL, and data analysis
• Ability to work with large datasets and analyze data
• Knowledge of cloud computing and distributed systems
• Ability to write efficient and optimized code
• Knowledge of data security and privacy

What is Pyspark Data Engineer Qualifications?

• Bachelor’s degree in Computer Science, Information Technology, or related field
• 5+ years of experience in data engineering
• Experience with data warehousing and data lake architectures
• Experience with big data technologies such as Hadoop, Spark, and Kafka
• Knowledge of data modeling, ETL, and data analysis
• Knowledge of cloud computing and distributed systems
• Ability to write efficient and optimized code
• Knowledge of data security and privacy
Know