Data Engineer

5 days ago

Bengaluru, India Teamware Solutions Full time

Job Description We are seeking a skilled Data Engineer with hands-on experience in Databricks and PySpark to design and implement scalable data pipelines and analytics solutions. The ideal candidate will work closely with data architects, analysts, and business stakeholders to transform large volumes of raw data into clean, usable datasets that drive business decisions. Key Responsibilities: - Design, develop, and maintain ETL/ELT pipelines using Databricks, PySpark, and Apache Spark. - Build data lakes and data warehouses on cloud platforms (preferably Azure, AWS, or ). - Implement scalable and optimized data transformation processes for structured and semi-structured data. - Collaborate with data analysts and data scientists to understand data requirements and provide clean, curated datasets. - Perform data quality checks, validation, and error handling within pipelines. - Optimize data pipelines for performance, cost-efficiency, and resilience. - Monitor and troubleshoot data jobs using tools such as Databricks Jobs, Apache Airflow, or Azure Data Factory. - Ensure compliance with data security, privacy, and governance standards. Required Skills: - 45 years of experience as a Data Engineer. - Strong hands-on experience with Databricks, PySpark, and Apache Spark. - Proficiency in Python and SQL for data manipulation and processing. - Experience working with big data platforms and cloud ecosystems (Azure, AWS, or GCP). - Knowledge of Delta Lake, Lakehouse architecture, and Parquet/Avro file formats. - Familiarity with Git, CI/CD pipelines, and Agile development practices. Preferred Skills: - Experience with Airflow, Azure Data Factory, or other orchestration tools. - Understanding of data modeling techniques (star schema, snowflake). - Knowledge of DevOps and infrastructure as code tools (Terraform, ARM templates) is a plus. - Exposure to machine learning pipelines or MLflow is a bonus.

  • Data Entry Operator

    2 weeks ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Snowflake Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Snowflake Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties:...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Technical Lead- Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...