Data Engineer

4 days ago


India Anlage Infotech Pvt Ltd Full time

Key Responsibilities : - Framework Development & Optimization : Design and develop modular, reusable, and scalable Python-based frameworks to support data engineering and processing tasks. - Data Engineering & Transformation : Implement and maintain frameworks that facilitate the ingestion, transformation, and processing of large datasets using Azure services. - Pipeline Orchestration & Automation : Develop and optimize data engineering pipelines leveraging Azure Function Apps, Databricks (PySpark), and Apache Airflow to ensure efficient data processing. - Real-Time & Event-Driven Architectures : Design and implement real-time data streaming solutions and event-driven architectures using Azure Event Hub. - Data Warehousing & Dimensional Modeling : Work with dimensional modeling concepts to build robust data warehouse architectures, ensuring optimized storage and retrieval for analytics and reporting. - Integration with Azure Data Services : Architect and integrate frameworks with Azure Data Lake, Azure Storage, and Cosmos DB to enable seamless data flow and management. - Serverless Data Engineering Solutions : Design and deploy serverless solutions using Azure Function Apps to support scalable and cost-efficient data engineering frameworks. - CI/CD & DevOps Implementation : Develop and manage CI/CD pipelines using Azure DevOps, ensuring streamlined integration, testing, and deployment of data engineering frameworks. - Automated Testing & Monitoring : Implement automated testing, deployment, and monitoring processes to maintain high-quality code, performance optimization, and rapid iteration. Required Skills & Experience : - Strong expertise in Python, with a focus on developing scalable frameworks for data engineering. - Hands-on experience with Azure cloud services, including Azure Function Apps, Event Hub, Data Lake, Storage, and Cosmos DB. - Proficiency in PySpark and Databricks, with experience in handling large-scale data processing and transformation. - Strong background in Apache Airflow for workflow orchestration and pipeline automation. - Expertise in Data Warehousing concepts, including dimensional modeling, star schema, and optimized data storage. - Experience in real-time data streaming and event-driven architectures using Azure Event Hub. - Strong understanding of CI/CD principles with hands-on experience in Azure DevOps for deployment automation. - Knowledge of automated testing, monitoring, and logging for maintaining high-performance data pipelines. - Problem-solving mindset with a focus on scalability, efficiency, and automation in data engineering solutions. (ref:hirist.tech)



  • India NTT DATA Full time

    Position Summary:We are looking for a talented Cloud Engineer to join our team at NTT DATA. The successful candidate will be responsible for designing and implementing data warehousing solutions using Redshift, Airflow, and Python. Responsibilities:Design and implement data warehousing solutions using Redshift and Airflow.Develop and maintain complex data...

  • Data Engineer

    3 days ago


    India Tatras Data Services Pvt Ltd Full time

    At Tatras Data Services Pvt Ltd, we are seeking an experienced Data Engineer to join our team as a contractor.The ideal candidate will have a strong background in designing, implementing, and managing large-scale data platforms using Data Fabric or Data Bricks. This includes experience working with both structured and unstructured data and having...

  • Junior Data Engineer

    4 weeks ago


    india Pacific Data Integrators Full time

    Junior Data Engineer (Immediate Joiner Only)Location: RemoteWorking Hours: 5 PM – 2 AM IST shiftMUST be ready to join in 15 days notice MaxMUST have good comm skillsMUST have experience between 1-2 years MAX, not more than thatPacific Data Integrators (PDI) is currently hiring JUNIOR ETL / DATA ENGINEER (GURUGRAM) for its enterprise client projects...


  • India ENABLE DATA TECHNOLOGIES PRIVATE LIMITED Full time

    **Job Description:**We're looking for a seasoned Senior Spark/Java Developer to join our team at Enable Data Technologies Private Limited.This role requires a deep understanding of software engineering principles, particularly in designing and developing large-scale data processing systems using Spark-based frameworks.As a member of our team, you'll work...


  • India Data Unveil Full time

    About Data UnveilData Unveil is a cutting-edge technology firm that empowers businesses with innovative data solutions.We are looking for a highly skilled Python Developer to join our team. As a Python Developer at Data Unveil, you will play a key role in developing and optimizing ETL workflows and data pipelines using Python and PySpark.Key...


  • India NTT DATA Full time

    Job Description:We are looking for an experienced Cloud Engineer who will be responsible for designing and implementing scalable data warehouses using Redshift, Airflow, and Python. The successful candidate should have hands-on experience with Linux/Unix, Stored Procedures, and ETL processes.Key Responsibilities:Design and implement data warehousing...


  • India NTT DATA Full time

    Company Overview:NTT DATA is a global leader in digital transformation, and we are looking for a talented AWS Cloud BI Data Engineer to join our Pan India team.Salary:The salary for this position will be determined based on the candidate's qualifications and experience.Job Description:In this role, you will be responsible for designing and implementing...

  • PySpark Developer

    3 days ago


    India DATA ECONOMY PRIVATE LIMITED Full time

    Job OverviewDATA ECONOMY PRIVATE LIMITED seeks a skilled PySpark Developer - Data Engineer to lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. As a key member of our team, you will design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.About the Job- Develop...

  • Tatras Data

    4 days ago


    India Tatras Data Services Pvt Ltd Full time

    Job Title : Data Engineer - Data Fabric/Bricks Location : Remote Job Summary : We are seeking an experienced Data Engineer to join our team as contractor. The ideal candidate will have a strong background in designing, implementing, and managing large-scale data platforms using Data Fabric or Data Bricks. The candidate should have experience working with...


  • India Big Data Trunk Full time

    Job DescriptionThe ideal candidate will possess strong technical skills, including basic programming knowledge and proficiency in data search and discovery. Excellent communication skills are also essential for collaboration and reporting within cross-functional teams.Data Search & Discovery – Identify, analyze, and structure data from various sources for...

  • Redshift Engineer

    2 days ago


    India NTT DATA Full time

    Job Summary:NTT DATA is seeking a highly skilled Cloud Engineer to join our team. The successful candidate will be responsible for designing and implementing data warehousing solutions using Redshift, Airflow, and Python. Key Responsibilities:Design and implement data warehousing solutions using Redshift and Airflow.Develop and maintain complex data...

  • Data Scientist

    4 weeks ago


    India Applied Data Finance Full time

    Job Description: Data Scientist with good Business analytics Experience (Preferably in financial domain, but not mandatory) Position Title: Data Scientist/Senior Data ScientistLocation: Remote (Hybrid option available, if in Chennai) Department: Analytics, Risk and R&DPosition Type: Full-TimeJob Summary: We are seeking skilled and motivated Data Scientists...

  • Data Scientist

    4 weeks ago


    India Applied Data Finance Full time

    Job Description: Data Scientist with good Business analytics Experience (Preferably in financial domain, but not mandatory) Position Title: Data Scientist/Senior Data Scientist Location: Remote (Hybrid option available, if in Chennai) Department: Analytics, Risk and R&D Position Type: Full-Time Job Summary: We are seeking skilled and motivated...


  • India Big Data Trunk Full time

    Job Title: Data Discovery ProfessionalSummary: We are seeking a detail-oriented and motivated individual to assist in data discovery, quality, and research as part of our Big Data Trunk team.Responsibilities:Identify, analyze, and structure data from various sources for actionable insights.Ensure clean, structured, and consistent data for business operations...


  • India Big Data Trunk Full time

    Job SummaryWe are seeking a skilled Data Insight Analyst to join our team at Big Data Trunk. As a key member of our analytics team, you will be responsible for discovering and analyzing data from various sources to provide valuable insights.About the RoleIdentify, analyze, and structure data from multiple sources to uncover hidden patterns and trends.Work...


  • India Tatras Data Services Pvt Ltd Full time

    Tatras Data Services Pvt Ltd is looking for a highly skilled Data Engineer to design, implement, and manage large-scale data platforms using Data Fabric or Data Bricks.The ideal candidate will have experience working with both structured and unstructured data and have successfully implemented at least one full lifecycle of a data platform.Key...


  • India NTT DATA Full time

    Company Overview:NTT DATA is a trusted partner in digital transformation, and we are seeking a highly skilled AWS Cloud BI Data Engineer to join our Pan India team.Salary:The compensation package for this role will be commensurate with the candidate's experience and qualifications.Job Description:In this key position, you will design, build, and maintain...


  • India Big Data Trunk Full time

    About Big Data TrunkAt Big Data Trunk, we're on a mission to harness the power of data to drive business growth. Our team of experts is dedicated to delivering innovative solutions that meet the evolving needs of our clients.Job DescriptionWe're seeking a highly motivated and detail-oriented Data Discovery Analyst Intern to join our team. As a key member of...

  • Software Engineer

    3 weeks ago


    India Central Data Storage Full time

    Company DescriptionCentral Data Storage is a Series A-funded startup at the forefront of data backup and cybersecurity. We empower mid-market and enterprise businesses with comprehensive data protection and business continuity solutions.Role DescriptionThis is a full-time on-site Software Engineer role located in Hyderabad, India at Central Data Storage. The...

  • Data Engineer

    4 weeks ago


    india, india Zemoso Technologies Full time

    Job Title: Data Engineer Experience: We are seeking a highly skilled Data Engineer with 3+ years of experience in data pipelines. Location: Chennai/Mumbai Work Type: Hybrid Job Type: Full-time Key Responsibilities: We are looking for a talented individual who can demonstrate a strong command of Python programming language and contribute to the development...