Data Engineer

4 days ago

Bengaluru, Karnataka, India AKSHAYA BUSINESS IT SOLUTIONS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Position : Data Engineer - Azure

Experience : 4 to 8 Years

Location : Bangalore

Job Type : Full-time

Job Summary :

We are seeking a highly skilled Data Engineer with 4 to 8 years of experience, specializing in the Microsoft Azure ecosystem. The ideal candidate will have a minimum of 3 years of core experience in MS Azure and Databricks. This role requires deep expertise in developing scalable, real-time data platforms and pipelines using a security-first approach, leveraging technologies like Python, PySpark, and Spark Structured Streaming within the Azure cloud environment.

Key Responsibilities :

- Azure & Databricks Development : Architect, design, and develop end-to-end cloud-based analytics solutions and data platforms (Data Lakes/Lakehouses), with a primary focus on MS Azure and Databricks Delta Lakehouse architecture.

- Real-Time Data Workflows : Design and develop robust real-time data workflows and pipelines using (Py)Spark Structured Streaming solutions to handle continuous data ingestion and processing.

- ETL/ELT & Programming : Build and optimize efficient ETL or ELT processes. You must maintain expert-level proficiency in mandatory programming skills : Python, PySpark, and SQL.

- Data Modeling : Apply expertise in Data modeling principles, particularly with RDBMS systems, and hands-on experience with the PostgreSQL database.

- DevOps & Security : Architect and design data pipelines using CI/CD methodology. You must be comfortable and proficient in adopting security-first development principles throughout the entire data engineering lifecycle.

Qualifications :

- Experience : 4 to 8 years of professional experience in Data Engineering.

- Core Cloud Experience : Minimum of 3 years of core experience in MS Azure and Databricks.

- Mandatory Technical Stack : Expert proficiency in Databricks, Python, PySpark, Spark Streaming, and SQL.

- Architecture : Experienced in the architecture, design, and development of Data platforms / Datalakes, preferably using the Databricks Delta Lakehouse approach.

- Data Flow : Proven experience with the architecture and design of real-time data workflows using Structured Streaming.

- Modeling : Expertise in Data modelling with RDBMS systems, specifically PostgreSQL database.

- Process : Experience in designing data pipelines using CI/CD methodology.

- Soft Skills : Strong development and problem-solving skills, with a commitment to secure development practices.

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    3 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    -2215 seconds ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Technical Lead- Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Data Engineer

    1 hour ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - DBT to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: We are seeking an Engineer to...

  • Senior, Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...