Data Engineer

Job Role – Data Engineer

Job Location – Jaipur

Job Type – Permanent

Experience Required- (2-4) Years

As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure. You will work closely with our data scientists, analysts, and other stakeholders to ensure data is accurate, timely, and accessible. Your contributions will directly impact our data-driven decision-making and support our growth.

Key Responsibilities:

• Data Pipeline Development: Design, develop, and implement data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation, and movement of data.

• ETL Processes: Develop and optimize ETL (Extract, Transform, Load) processes to ensure efficient data flow and transformation.

• Data Lake Management: Develop and maintain Azure Data Lake solutions, ensuring efficient storage and retrieval of large datasets.

• Data Warehousing: Work with Azure Synapse Analytics to build and manage scalable data warehousing solutions that enable advanced analytics and reporting.

• Data Integration: Integrate various data sources into MS-Fabric, ensuring data consistency, quality, and accessibility across different platforms.

• Performance Optimization: Optimize data processing workflows and storage solutions to improve performance and reduce costs.

• Database Management: Manage and optimize databases (SQL and NoSQL) to support high-performance queries and data storage requirements.

• Data Quality: Implement data quality checks and monitoring to ensure accuracy and consistency of data.

• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.

• Documentation: Create and maintain comprehensive documentation for data processes, pipelines, and infrastructure, architecture and best practices.

• Troubleshooting and Support: Identify and resolve issues in data pipelines, data lakes, and warehousing solutions, providing timely support and maintenance.

Qualifications:

• Experience: 2-4 years of experience in data engineering or a related field.

• Technical Skills:

o Proficiency with Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake

o Experience with Microsoft Fabric is a plus

o Strong SQL skills and experience with data warehousing concepts (DWH)

o Knowledge of data modeling, ETL processes, and data integration

o Experience with relational databases (e.g., MS-SQL, PostgreSQL, MySQL)

o Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend)

o Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus

o Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated data services (e.g., S3, Redshift, BigQuery)

o Familiarity with data visualization tools (e.g., Power BI) and experience with programming languages such as Python, Java, or Scala.

o Experience with schema design and dimensional data modeling

• Analytical Skills: Strong problem-solving abilities and attention to detail.

• Communication: Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders.

• Education: Bachelor's degree in computer science, Engineering, Mathematics, or a related field. Advanced degrees or certifications are a plus.

Share your cv or reference at sulabh.tailang@celebaltech.com