Data Engineer- 2

1 day ago

Bengaluru, Karnataka, India DBiz ai solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Position: Senior Data Engineer

We are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions. You will also contribute to optimizing database performance and ensure that data systems meet both scalability and security standards.

Key Responsibilities:

  • Develop, optimize, and maintain scalable ETL pipelines for processing large datasets using Databricks and Pyspark.
  • Apply advanced techniques such as chunking and partitioning to handle large file volumes efficiently.
  • Tuning and optimizing databases for better performance and storage efficiency.
  • Collaborate with cross-functional teams to ensure the architecture meets business requirements and data quality standards.
  • Design and implement solutions with an eye toward scalability and long-term performance.
  • Work with Azure services, with exposure to Azure Function Apps, Azure Data Factory, and Cosmos DB (preferred).
  • Communicate effectively with stakeholders to align on project goals and deliverables.

Key Skills and Experience:

  • Databricks (advanced-level skills in data engineering workflows)
  • Pyspark (intermediate-level skills for processing big data)
  • Strong ETL design skills, particularly in partitioning, chunking, and database tuning for large datasets
  • Azure experience (a plus, including Function Apps, Cosmos DB, and Azure Data Factory)
  • Excellent communication skills for effective collaboration with teams and stakeholders

  • Data Engineer 2

    2 weeks ago

    Bengaluru, Karnataka, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    2 days ago

    Bengaluru, Karnataka, India Yubi Full time

    Data Engineer 2Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines...

  • Data Engineer 2

    6 days ago

    Bengaluru, Karnataka, India Yubi Full time US$ 1,00,000 - US$ 1,50,000 per year

    About UsYubi stands for ubiquitous. But Yubi will also stand for transparency, collaboration, and the power of possibility.From being a disruptor in India's debt market to marching towards global corporate markets from one product to one holistic product suite with seven productsYubi is the place to unleash potential. Freedom, not fear. Avenues, not...

  • Data Engineer, 2

    1 week ago

    Bengaluru, Karnataka, India Dotdash Meredith Full time

    Job Title Data Engineer 2Primary responsibilities Create Star schema data models perform ETLs ELT and validate results with business representatives Collate raw data from various financial sources of the organization Push collated data into inhouse database run reports for dashboards and KPIs Support implemented BI solutions by monitoring and tuning...

  • Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Software Engineer 2 – Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Her Second Innings Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Software Engineer 2 – Data EngineerWork Location: BangaloreJob Description – What You'll DoThe Marketing Engineering organization in Strategy, Planning & Operations is looking for a Data Engineer eager to provide the engineering muscle for core engineering work around data architecture, data pipeline development, and deploying...

  • Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...