Senior Big Data Engineer

3 weeks ago


Bengaluru, Karnataka, India CORTEX Consultants Full time

Job Title : Senior Big Data Developer

Location : Bangalore, India

Experience : 5 to 10 years

Job Description :

We are seeking a talented Senior Big Data Developer to join our team in Bangalore. In this role, you will design, develop, and maintain scalable data pipelines and systems using Apache Spark, Databricks, and SQL. You will collaborate with data scientists, analysts, and other stakeholders to deliver robust and high-quality data solutions. Your expertise will play a key role in optimizing workflows, ensuring data integrity, and developing efficient ETL processes for ingesting and transforming data.

Key Responsibilities :

- Design and build scalable and efficient data pipelines using Apache Spark, Databricks, and SQL.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver impactful data solutions.

- Optimize and fine-tune data processing workflows for improved performance and scalability.

- Implement comprehensive data quality checks and ensure data integrity across various data sources.

- Develop and maintain robust ETL processes to ingest and transform data from a variety of sources.

- Monitor and troubleshoot data pipeline issues, ensuring timely and effective resolutions.

- Keep up-to-date with the latest industry trends, tools, and technologies in data engineering.

Requirements :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 5+ years of experience in data engineering or a related role.

- Strong proficiency in Apache Spark and Databricks.

Advanced skills in SQL, including experience with complex queries and performance tuning.

Experience working with cloud platforms like AWS, Azure, or Google Cloud.

Proficiency in programming languages such as Python or Scala.

Familiarity with data warehousing concepts and technologies such as Snowflake and Redshift.

Excellent problem-solving skills with keen attention to detail.

Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications :

Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).

Knowledge of data governance and security best practices.

Experience with CI/CD pipelines and DevOps practices.

(ref:hirist.tech)

  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services is a global leader in consulting and information technology, partnering with its clients to solve complex business challenges and leverage innovation on their behalf.Job SummaryWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in designing and...


  • Bengaluru, Karnataka, India Andor Tech Full time

    Hiring: Senior Big Data EngineerLocation: Bangalore (AndorTech Deployment – Product-Based Retail MNC)Experience: 6+ YearsSkills Required: Strong experience in PySpark, Scala & SQL Hands-on expertise in coding with Scala & PySpark Proficient in SQL query writing Immediate joiners preferredIf you're interested, share your details with Anusha Shetty at ...


  • Bengaluru, Karnataka, India Andor Tech Full time

    Hiring: Senior Big Data Engineer Location: Bangalore (AndorTech Deployment – Product-Based Retail MNC) Experience: 6+ Years Skills Required: Strong experience in PySpark, Scala & SQL Hands-on expertise in coding with Scala & PySpark Proficient in SQL query writing Immediate joiners preferredIf you're interested, share your details with Anusha...


  • Bengaluru, Karnataka, India BYTESPRINT TALENT SEARCH LLP Full time

    About BYTESPRINT TALENT SEARCH LLP">As a leader in data engineering, we are seeking an experienced professional to join our team as a Senior Big Data Specialist.">Job Overview:">The Senior Big Data Specialist will be responsible for designing and implementing scalable data architectures for enterprise-scale projects, developing robust ETL/ELT workflows, and...


  • Bengaluru, Karnataka, India NTT DATA Global Delivery Services Limited Full time

    Job Description:We are seeking a Senior Big Data Solutions Architect to lead our big data initiatives. The successful candidate will design, build, and maintain scalable data pipelines using Databricks on AWS. This includes data integration, data processing, and data architecture. The ideal candidate will have strong experience with Databricks, including...

  • Big Data Developer

    7 days ago


    Bengaluru, Karnataka, India EXL Service Full time

    Data Engineer Job Description:EXL Service is seeking a highly skilled Senior Manager to lead our data engineering team. As a Senior Manager, you will be responsible for designing and implementing large-scale data pipelines using big data technologies.Key Responsibilities:Collaborate with project stakeholders to identify product and technical...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data Engineer Location : Bangalore Employment Type : Full-time Work Mode : 4 Days Work from Office Notice Period : Immediate to 30 days Job Description : We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in...


  • Bengaluru, Karnataka, India Impetus Full time

    Job OverviewWe are seeking a skilled Senior Big Data Engineer to join our team at Impetus. In this role, you will be responsible for designing, building, and maintaining large-scale data processing systems.About the RoleThis is a senior-level position that requires extensive experience in big data technologies.You will work closely with our data engineering...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities : - Design, develop, and execute test cases for large-scale big data platforms. - Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases). - Ensure data accuracy, integrity, and quality in data processing and transformations. - Work closely with developers, data engineers, and business analysts to...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Scoop Technologies Pvt Ltd Full time

    Job Title : Big Data EngineerLocation : BangaloreEmployment Type : Full-timeWork Mode : 4 Days Work from OfficeNotice Period : Immediate to 30 daysJob Description :We are looking for a Big Data Engineer with expertise in Hadoop, Hive, SQL, Python, PySpark, and AWS to join our team in Bangalore. The ideal candidate will have hands-on experience in designing,...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Human Horizon Full time

    Responsibilities :- Design, develop, and execute test cases for large-scale big data platforms.- Perform testing on various Big Data technologies (e. g., Hadoop, Hive, Spark, NoSQL databases).- Ensure data accuracy, integrity, and quality in data processing and transformations.- Work closely with developers, data engineers, and business analysts to...

  • Big Data Engineer Lead

    13 hours ago


    Bengaluru, Karnataka, India Pylon Management Consulting Full time

    Pylon Management Consulting is seeking a Senior Big Data Engineer to join our team.About the RoleWe require a technical expert to design, develop, and optimize Big Data systems on Cloudera platforms. The ideal candidate will have extensive knowledge of industry-standard tools, programming languages, and Big Data frameworks.Key Accountabilities:Develop and...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionWe are currently seeking a Data Engineer to join our team in India. The ideal candidate will have expertise in AWS services such as EC2, Lambda, and EMR, with configuration using Terraform. Additionally, experience with Big Data Hadoop, Spark, Scala, Control-m, GIT, Maven, Jenkins, and SQL is required.


  • Bengaluru, Karnataka, India Andor Tech Full time

    Hiring: Senior Big Data EngineerLocation: Bangalore (AndorTech Deployment – Product-Based Retail MNC)Experience: 6+ YearsSkills Required: Strong experience in PySpark, Scala & SQL Hands-on expertise in coding with Scala & PySpark Proficient in SQL query writing Immediate joiners preferredIf you're interested, share your details with Anusha Shetty at...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India TEKDOORS Full time

    We are looking for a Big Data Engineer to build scalable data pipelines and support enterprise analytics applications by integrating and processing large datasets. Roles and Responsibilities : - Develop and manage data pipelines for integrating, consolidating, and cleansing data. - Utilize ETL tools and REST APIs for data integration and management. - Plan,...


  • Bengaluru, Karnataka, India LUXOFT Full time

    Job OverviewLuxoft is seeking an experienced Senior Big Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for managing and analyzing large datasets to support business initiatives.Key ResponsibilitiesEnsuring high-quality data output is submitted in a timely manner and effectively communicated.Continuously...


  • Bengaluru, Karnataka, India Andor Tech Full time

    Job title: Senior Big Data Engineer Experience: 4+ Years Notice Period: Immediate to 15 days only Location: Manyata Embassy Business Park, Bangalore. Mode of Employment: Contract (Long term) Mode Of Work: Hybrid (2-3 days in a Week- Mandatory) 4-year degree in Quantitative disciplines (Science, Technology, Engineering, Mathematics) or equivalent experience 4...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Title: Senior Data Engineering Professional - Big Data SpecialistWe are looking for a skilled Data Engineer to join our team at Tata Consultancy Services.This is an exciting opportunity for someone who wants to work with cutting-edge technologies and be part of a dynamic team that drives innovation in the field of data engineering.About the Role:The...


  • Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Description :- Lead the architecture and design of our big data platform, ensuring scalability, reliability, and performance.- Perform and oversee data ingestion tasks, including writing scripts, calling APIs, web scraping, and writing complex SQL queries.- Design and implement data stores (data lakes, data warehouses) that support the scalable...


  • Bengaluru, Karnataka, India LIVE CONNECTIONS PLACEMENTS PRIVATE LIMITED Full time

    Responsibilities - Utilize the data engineering skills within and outside of the developing information ecosystem for discovery, analytics and data management. - Work with data science team to deploy Machine Learning Models. - You will be using Data wrangling techniques converting one "raw" form into another including data visualization, data aggregation,...