Unfortunately, this job posting is expired.
Don't worry, we can still help! Below, please find related information to help you with your job search.
Don't worry, we can still help! Below, please find related information to help you with your job search.
Related keywords
Some similar recruitments
Manager, Data Center Infrastructure
Recruited by NVIDIA 9 months ago
Address , Santa Clara
$132,000 - $253,000 a year
Data Engineer Jobs
Recruited by CoStar Group 9 months ago
Address , San Diego, 92122
Data Engineer Jobs
Recruited by Sephora 9 months ago
Address , San Francisco, 94105
$141,000 - $155,000 a year
Data Engineer Jobs
Recruited by Centerfield 9 months ago
Address , Los Angeles
$80,000 - $115,000 a year
Project Engineer - Infrastructure
Recruited by Kiewit 9 months ago
Address Santa Fe Springs, CA, United States
Automation Project Engineer Jobs
Recruited by ROI Engineering LLC 9 months ago
Address Los Angeles Metropolitan Area, United States
Data Engineer Jobs
Recruited by SS&C 9 months ago
Address , San Francisco, Ca
$141,000 - $153,000 a year
Infrastructure Engineer Jobs
Recruited by Wells Fargo 9 months ago
Address , San Leandro, Ca
Infrastructure Engineer Jobs
Recruited by Fox Corporation 9 months ago
Address , Los Angeles, Ca
Systems Engineer Jobs
Recruited by Miso Robotics 9 months ago
Address Pasadena, CA, United States
Data Engineer Jobs
Recruited by SnapX.ai 9 months ago
Address Hydesville, CA, United States
Data Engineer Jobs
Company | Sweven Infotech |
Address | San Francisco Bay Area, United States |
Employment type | FULL_TIME |
Salary | |
Expires | 2023-07-27 |
Posted at | 10 months ago |
Job - Data Engineer
Location – San Francisco Bay Area
Experience – 5 to 8 years
Job Type - Full Time & C2H (Only independent candidates can apply)
Responsibilities:
- Stay up to date with emerging technologies and best practices in data engineering and big data processing.
- Create and maintain documentation related to data architecture, data pipelines, and data models.
- Monitor and troubleshoot data pipelines to ensure data availability and reliability.
- Provide thought leadership in the Databricks and Lakehouse space, both within the organization and externally
- Mentor and train other data engineers on best practices for data engineering and Databricks usage
- Implement best practices for data governance, data security, and data quality to ensure data integrity across all data sources.
- Optimize and tune data pipelines for performance and scalability.
- Develop and implement effective data architecture solutions using Databricks and Lakehouse
- Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and build solutions that enable them to extract insights from data.
Qualifications:
- 3+ years of experience working with Databricks and PySpark
- 5-8+ years of experience with SQL
- Strong understanding of data engineering, data warehousing, data modeling, data governance, and data security best practices.
- Working knowledge of DLT (Delta Live Tables) and Unity Catalog a plus
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
- Appreciation for the Lakehouse medallion data architecture – bronze, silver, gold – and how those data stages are used.
- Experience mentoring and training other data engineers.
- Strong understanding of ETL and ELT data ingestion, acquisition, and data processing patterns
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
- Experience with cloud-based data warehousing platforms such as Synapse, AWS Redshift, Google BigQuery, or Snowflake
- Excellent problem-solving and troubleshooting skills.
- Experience within Programming languages Python, Scala and Java (Python preferred)
- 5+ years of experience in data engineering
Feel free to contact for any further queries on [email protected]
Thank you..!!
-
Systems Analyst - Excel, Xml, Sql, Scripting
By CyberCoders At Salt Lake City, UT, United States 8 months ago
-
(Senior) Finance & Shared Services Manager
By Catholics For Choice At Washington, DC, United States 8 months ago
-
Paralegal - Probate Administration
By CyberCoders At Miami, FL, United States 8 months ago
-
Account Executive - Automotive Software
By ECW Search At United States 8 months ago
-
Construction Project Coordinator Jobs
By CyberCoders At River Falls, WI, United States 8 months ago