Senior Data Engineer

4 weeks ago

Chennai, India Mastech InfoTrellis Full time

Job Description :


Position : Azure Data Engineer Lead and Developer


Location : Chennai (Hybrid-3 days a week)/ If Non Local, need quarterly once, sit with team for a week or two

Duration : Full Time

Positions : 7

Notice Period : 15-40 days (Non- Negotiable)

Job Summary :

We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. You will play a critical role in ensuring that our data infrastructure is robust, scalable, and capable of supporting our data analytics and business intelligence needs.

Responsibilities :

Data Modelling :


- Design, develop and maintain data models, schemas, and data warehouses in Azure SQL Data Warehouse or other relevant data warehousing solutions to support analytical and reporting needs.

- Ensure data is organized efficiently for optimal query performance.

Data Transformation & ETL :


- Implement data transformation workflows and processes, including data cleansing, enrichment, and aggregation, using Azure Data Factory, Azure Databricks, or other ETL relevant tools to move data between systems for analytics and reporting.

Data Ingestion and Integration :


- Design, develop, and maintain data pipelines for ingesting data from various sources, both structured and unstructured, into Azure data platforms ensuring data quality and reliability.

Data Storage and Management :


- Design, implement and manage data storage solutions on Azure, including Azure SQL Database, Azure Data Lake Storage, Cosmos DB, and Azure Blob Storage, while optimizing for performance, scalability, and cost-efficiency.

Data Security :


- Implement data security measures, including encryption, access control, and compliance with data privacy regulations like GDPR, HIPAA, etc.

Monitoring :


- Monitor data pipelines and storage systems for performance and reliability, proactively identifying and resolving issues.

- Optimize data solutions for cost-effectiveness.

Performance Optimization :


- Optimize data pipelines and queries for performance and cost efficiency, monitoring and troubleshooting as needed to meet service-level agreements (SLAs).

Collaboration :


- Collaborate with cross-functional teams, including data scientists, analysts, and application developers, to understand their data requirements and provide them with access to clean and well-organized data that meet business requirements.

Documentation :


- Maintain comprehensive documentation for data pipelines, data models, configurations, processes, and storage solutions for knowledge sharing and future reference.

Continuous Learning :


- Stay up to date with Azure data services and emerging trends in data engineering and cloud technologies.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).

- Proven experience as a Data Engineer with a focus on Azure data services.

- Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Blob Storage, etc.

- Proficiency in ETL (Extract, Transform, Load) processes and data integration techniques.

- Experience with data modelling and data warehousing concepts.

- Knowledge of data governance and security best practices.

- Programming skills in languages such as Python, SQL, or Scala.

- Familiarity with version control systems (e., Git) and DevOps practices.

- Strong problem-solving and troubleshooting skills.

- Excellent communication and teamwork skills.

Preferred Qualifications :

- Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect.

Experience with DevOps practices and tools for automation and continuous integration and deployment (CI/CD)

- Experience with big data technologies like Apache Spark, Hadoop, or Hive.

- Familiarity with data visualization tools like Power BI or Tableau

(ref:hirist.tech)

  • Senior Data Engineer

    1 month ago

    Chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities:As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    4 months ago

    Chennai, India Saaki Argus & Averil Consulting Full time

    Hiring Senior Data Engineer for an IT Product Company Location : Chennai / Pune Role: Senior Data Engineer: Minimum 4+Yrs of Relevant Experience Mandatory Skills: Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or Azure cloud Master's degree in either software engineering, data engineering, data science, computer...

  • Senior Data Engineer

    1 month ago

    Chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    1 month ago

    Chennai, India Zuci Systems Full time

    Job Title: Senior Data Engineer Responsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the...

  • Senior Data Engineer

    1 day ago

    chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    1 month ago

    Chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    16 minutes ago

    chennai, India Zuci Systems Full time

    Job Title: Senior Data Engineer Responsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the...

  • Director of Data Engineering

    1 day ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionaryDirector of Data Engineeringto lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    4 days ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    2 days ago

    chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Director of Data Engineering

    4 days ago

    chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Director of Data Engineering

    4 days ago

    Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Senior Data Engineer

    1 month ago

    Chennai, India KANINI Full time

    Senior Data EngineerJob Overview:We are seeking a highly skilled Senior Data Engineer with 6-10 years of experience to lead and manage our data-driven projects. The ideal candidate should have a strong background in SQL, PySpark, AWS, Databricks, and Scala, with proven expertise in migration projects and Jira. This role requires excellent communication...

  • Senior Data Engineer

    4 months ago

    Chennai, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Senior Data Engineer

    3 months ago

    chennai, India PPLABILITY (OPC) PRIVATE LIMITED Full time

    Job Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...

  • Senior Data Engineer

    2 months ago

    Chennai, India Ciklum Full time

    Description Ciklum  is looking for a Senior Data Engineer  to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and...

  • Senior Data Engineer

    3 weeks ago

    chennai, India Truelancer.com Full time

    Job Title: Sr Data EngineerExperience: 5 - 9 yrsLocation: Work from Office ,ChennaiMandatory Skills: AWS Data Services+Strong in SQL QueriesAs a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and analytics solutions. You will work with a range of AWS technologies and data tools to ensure our...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Programming.com Full time

    Job DescriptionJob Title: Senior Data EngineerLocation : ChennaiSalary : ₹13 LPAExperience Required : 6 YearsNotice Period : Immediate to 15 daysResponsibilities :♦ Design and optimize data processing systems.♦ Collaborate with teams to implement data models.♦ Ensure data architecture aligns with business needs.♦ Build and maintain data...

  • Senior Consultant

    4 months ago

    chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark,...

  • Senior Consultant

    4 months ago

    Chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark, and...