Data Engineering (Azure, Aws)

Volmatica is seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining the data infrastructure that enables seamless data collection, storage, processing, and analysis. Your expertise in developing robust ETL pipelines, data modeling, and database management will contribute significantly to our data-driven decision-making process.

Responsibilities:

1. Data Pipeline Development: Design, implement, and maintain efficient and reliable ETL (Extract, Transform, Load) pipelines to move and transform data from various sources into our data warehouse or data lake.
2. Data Modeling: Create and optimize data models to support business intelligence and analytics applications, ensuring data accuracy, completeness, and integrity.
3. Data Integration: Integrate and consolidate data from multiple systems and sources, including APIs, databases, and flat files, while addressing data quality and consistency challenges.
4. Data Warehousing: Manage and administer the data warehouse infrastructure, implementing performance tuning, indexing, and partitioning strategies to optimize query performance.
5. Database Management: Maintain and monitor database systems, ensuring high availability, reliability, and security of data.
6. Data Governance: Implement data governance and security measures to safeguard sensitive information and adhere to data compliance regulations.
7. Data Quality Assurance: Develop data validation and data cleansing processes to identify and rectify data inconsistencies or inaccuracies.
8. Data Documentation: Maintain clear and comprehensive documentation of data pipelines, data models, and database configurations.
9. Collaboration: Work closely with cross-functional teams, including data analysts, data scientists, and software developers, to understand data requirements and deliver data solutions that meet business needs.
10. Continuous Improvement: Stay updated with the latest data engineering trends, technologies, and best practices, and proactively identify opportunities to enhance data processing capabilities and overall system performance.

Qualifications:

1. Educational Background: Bachelor's or higher degree in Computer Science, Engineering, or a related field.
2. Experience: Proven experience as a Data Engineer or similar role, with hands-on expertise in designing and developing ETL pipelines and data warehousing solutions.
3. Programming Skills: Proficiency in programming languages such as Python, Java, Scala, or similar, with experience in data manipulation, scripting, and automation.
4. Database Knowledge: Strong understanding of relational and non-relational databases, SQL, and data modeling principles.
5. Big Data Technologies: Familiarity with distributed computing frameworks like Hadoop, Spark, or similar, and cloud-based data services (AWS, Azure, Google Cloud).
6. Data Integration: Experience with data integration techniques, including APIs, web services, and message queues.
7. Data Tools: Working knowledge of data integration tools (e.g., Apache NiFi), data orchestration tools (e.g., Apache Airflow), and version control systems.
8. Problem-Solving Skills: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues efficiently.
9. Team Player: Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
10. Adaptability: Demonstrated ability to adapt to evolving technologies and business requirements.

Preferred Qualifications:

1. Advanced Analytics: Familiarity with data analytics and data science concepts, including machine learning and statistical analysis.
2. Containerization: Experience with containerization technologies like Docker and orchestration tools like Kubernetes.
3. Data Visualization: Knowledge of data visualization tools (e.g., Tableau, Power BI) to create insightful and interactive reports.
4. Security: Understanding of data security principles and experience implementing data access controls and encryption methods.
5. Certifications: Relevant certifications in data engineering or related fields would be advantageous.

As a Data Engineer in our team, you will have the opportunity to contribute to the development of innovative data solutions that drive the success of our organization. If you are passionate about data and possess the required skills, we encourage you to apply and be a part of our exciting journey towards data excellence.