Data Engineer

2 days ago


Yelahanka, Karnataka, India Next-Link Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Experience: Minimum 4 years (relevant experience mandatory)


Key Skills Required
  • Strong hands-on experience with Scala (mandatory) and Apache Spark

  • Experience with Hadoop ecosystem – HDFS, Hive, Impala, Sqoop

  • Data ingestion and pipeline development for large-scale systems

  • Proficiency in Java and distributed data processing

  • Knowledge of data warehousing and query optimization

Job Description

We are seeking a skilled Data Engineer (Spark & Scala) with hands-on expertise in big data technologies and large-scale data processing. The role involves building and optimizing data ingestion pipelines, working with the Hadoop ecosystem, and ensuring high-performance data workflows.


Responsibilities
  • Design, develop, and optimize data ingestion pipelines using Spark and Scala.

  • Work with Hadoop ecosystem tools (HDFS, Hive, Impala, Sqoop) for large-scale data processing.

  • Collaborate with cross-functional teams to integrate structured and unstructured data sources.

  • Implement data transformation, validation, and quality checks.

  • Optimize data workflows for scalability, performance, and fault tolerance.

  • Write clean, efficient, and maintainable code in Scala and Java.

  • Ensure compliance with best practices for data governance and security.

Desired Candidate Profile
  • Minimum 4 years of experience in data engineering.

  • Strong expertise in Scala (mandatory) and Apache Spark.

  • Hands-on experience with Hadoop ecosystem tools (HDFS, Hive, Impala, Sqoop).

  • Proficiency in Java for distributed system development.

  • Strong problem-solving and analytical skills.

  • Ability to work in fast-paced, collaborative environments.




  • Data Engineer

    2 days ago


    Yelahanka, Karnataka, India OnebyZero Pte Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    The ability to design, implement, and optimize large-scale data and analytics solutions, Implementing ETL pipelines within and outside of a data warehouse using Python. Performing DML and DDL on Cloud Development of scripts using Python for loading, extracting, and transforming data. Assist with production issues in data warehouses like...

  • Data Engineer

    2 days ago


    Yelahanka, Karnataka, India Black & White Full time ₹ 22,00,000 per year

    Job Title : Data Engineer Qualification : BTech,B.E Experience : 5 to 8 Years Must Have Skills : Experience in data engineering, analytics engineering, or related fields, Expertise in SQL, Python, and data transformation frameworks, Strong experience with cloud-based data warehouses, Business knowledge and Retail Domain Knowledge, Good...


  • Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data...

  • Data Engineer

    1 day ago


    Yelahanka, Karnataka, India Black & White Full time ₹ 25,00,000 per year

    Job Title : Data Engineer Qualification : BTech,B.E Experience : 4 to 5 Years Must Have Skills : Power BI , DAX queries (3 Years) · DataBricks (Python/Scala) – 3 to 4 years · Azure data factory · SQL · Good Knowledge of DataWarehousing Good to Have Skills : Azure Blob storge. Lean & Agile Roles and Responsibilities : Good hands on experience on...


  • Yelahanka, Karnataka, India GeekSoft Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Requirements Key Responsibilities:Analyze and document...


  • Yelahanka, Karnataka, India Raytheon Technologies Full time

    Date Posted 2024-09-02Country IndiaLocation North Gate Business Park Sy No 2 1 and Sy No 2 2 KIAL Road Venkatala Village Chowdeshwari Layout Yelahanka Bangalore Karnataka 560064Position Role Type UnspecifiedOverview We are seeking for a Data Visualization Engineer Job Title Associate EngineerKey Responsibilities Data Analysis and Requirements...


  • Yelahanka, Karnataka, India Raytheon Technologies Full time

    Date Posted 2024-03-26Country IndiaLocation North Gate Business Park Sy No 2 1 and Sy No 2 2 KIAL Road Venkatala Village Chowdeshwari Layout Yelahanka Bangalore Karnataka 560064Position Role Type UnspecifiedKey Responsibilities Design develop and deploy state-of-the-art data-driven predictive descriptive models to solve business and engineering...

  • Data Analyst

    2 days ago


    Yelahanka, Karnataka, India Black & White Full time ₹ 32,00,000 per year

    Job Title : Master Of Data Management (MDM) Qualification : Any Graduate and Above Relevant Experience : – 15 Years Must Have Skills : MDM Tools Proficiency: Extensive hands-on experience with Informatics MDM, CluedIn, or similar MDM platforms. Data Expertise: Strong understanding of data modeling, data governance, data quality, and data...


  • Yelahanka, Karnataka, India ANRGI TECH Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities: Design and implement scalable data integration pipelines using Azure Data Factory, Azure Databricks, and ADLS Develop and deploy AI/ML models using Azure Machine Learning, Azure Cognitive Services, and other Azure AI services Integrate Azure AI services with existing infrastructure, ensuring seamless data flow and...

  • IT Engineer

    2 days ago


    Yelahanka, Karnataka, India GOURMET CAFE Full time ₹ 3,00,000 - ₹ 3,50,000 per year

    Key ResponsibilitiesInstall, configure, and maintain hardware, software, POS systems, and networks.Provide technical support for café operations, staff, and office teams.Troubleshoot IT issues including system errors, connectivity, and hardware failures.Maintain data security, backup systems, and access controls.Manage and update IT assets, licenses, and...