Senior-Big Data Engineer Jobs

DUTIES: Senior Big Data Engineer needed by AT&T Services, Inc. in Dallas, TX (and various unanticipated client sites throughout the U.S.; may work from home) to interpret the requirements of various big data analytic use cases and scenarios and driving the design and implementation of specific data models to ultimately help drive better business decisions through insights from 09 combination of external and AT&T's data assets. Develop the necessary enablers and data platform in the big data lake environment and has the responsibility of maintaining its integrity during the life cycle phases. Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools in the big data environment. Support the standardization, customization and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data. Implement statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports data scientists in data sourcing and preparation to visualize data and synthesize insights of commercial value. Work with big data policy and security teams and legal to create data policy and develop interfaces and retention models which requires synthesizing or anonymizing data. Develop and maintain data engineering best practices and contribute to insights on data analytics and visualization concepts, methods and techniques. Design data architecture and data modeling using various methodologies and provide technical knowledge of Extract/Transform/Load (ETL) solutions for business intelligence projects applications to manage enterprise data. Develop and promote a strategic vision of the data environment as well as deep-dive into detailed data analysis and data mapping/data profiling exercises and help client in achieving solutions. Work with stakeholders, product owners to understand business requirements and translate them into technically implementable individual user stories using agile methodologies. Serve as point-of-contact for technical issues faced by end users and the off-shore team relating to development, support and maintenance of business client on BI-Datawarehouse applications under various database platforms (Hadoop Bigdata, Teradata, Vertica, Azure cloud ADLS). Create PSD (Project Scope Document), HLD (High Level Design) and technical specification documents. Design and develop data products using Hadoop Ecosystem Components: HDFS, Hive, Spark, DataRouter on HWX(Hortonworks) distribution model. Create new data pipelines to ingest the data using NiFi tool into Azure ADLS gen2. Perform extensive tuning on different platforms Hive, PIG, MapReduce and Spark using various Memory level, Network, IO, environmental, data and application re-designing optimization.

REQUIREMENTS: Requires a Master’s degree, or foreign equivalent degree in Electrical Engineering, Electronic Engineering or Software Technology and two (2) years of experience in the job offered or two (2) years of experience designing data architecture and data modeling using various methodologies and provide technical knowledge of Extract/Transform/Load (ETL) solutions for business intelligence projects applications to manage enterprise data; developing and promoting a strategic vision of the data environment as well as deep-dive into detailed data analysis and data mapping/data profiling exercises and help client in achieving solutions; working with stakeholders, product owners to understand business requirements and translate them into technically implementable individual user stories using agile methodologies; serving as point-of-contact for technical issues faced by end users and the off-shore team relating to development, support and maintenance of business client on BI-Datawarehouse applications under various database platforms (Hadoop Bigdata, Teradata, Vertica, Azure cloud ADLS); creating PSD (Project Scope Document), HLD (High Level Design) and technical specification documents; designing and developing data products using Hadoop Ecosystem Components: HDFS, Hive, Spark, DataRouter on HWX(Hortonworks) distribution model; creating new data pipelines to ingest the data using NiFi tool into Azure ADLS gen2; and performing extensive tuning on different platforms Hive, PIG, MapReduce and Spark using various Memory level, Network, IO, environmental, data and application re-designing optimization.

Our Senior Big Data Engineers earn between $135,000 - $231,100 yearly. Not to mention all the other amazing rewards that working at AT&T offers.

Joining our team comes with amazing perks and benefits:

• Medical/Dental/Vision coverage

• 401(k) plan

• Tuition reimbursement program

• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)

• Paid Parental Leave

• Paid Caregiver Leave

• Additional sick leave beyond what state and local law require may be available but is unprotected

• Adoption Reimbursement

• Disability Benefits (short term and long term)

• Life and Accidental Death Insurance

• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal

• Employee Assistance Programs (EAP)

• Extensive employee wellness programs

• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone

AT&T is an Affirmative Action/Equal Opportunity Employer, and we are committed to hiring a diverse and talented workforce. EOE/AA/M/F/D/V

*np*