Big Data Engineer

3 months ago


Bengaluru, India Tavant Full time

Key Responsibilities :

- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.

- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.

- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver innovative data solutions.

- Optimize Spark jobs for performance and cost efficiency across large datasets.

- Ensure high data quality and integrity by implementing robust testing and validation practices.

- Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.

- Mentor junior developers and contribute to knowledge sharing and team development.

Required Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- At least 7 years of software development experience, with a minimum of 5 years focused on big data processing using Apache Spark and Java.

- Proficient in Java programming and familiar with the Scala programming language.

- Strong experience in designing and implementing scalable data processing pipelines using Apache Spark and Java.

- Solid understanding of big data technologies and ecosystems (HDFS, YARN, Kafka, HBase, etc.).

- Experience with cloud platforms (AWS, Azure, or GCP) and understanding of cloud-native services for data processing.

- Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.

- Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.

- Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical and non-technical stakeholders.

(ref:hirist.tech)
  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Wipro Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Wipro. This is a fantastic opportunity for individuals with expertise in designing, building, and maintaining large-scale data processing systems.About the Role:The ideal candidate will have hands-on experience with big data technologies such as Hadoop, Spark, and Kafka. You...

  • Big Data Engineer

    5 months ago


    Bengaluru, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...

  • Big data Engineer

    3 weeks ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big Data Engineer

    6 months ago


    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big data engineer

    1 month ago


    Bengaluru, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:..4Veröffentlichungsdatum:..4Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory: Deep hands-on...

  • Big Data Engineer 3

    1 month ago


    Bengaluru, Karnataka, India Oracle Full time

    Job SummaryWe are seeking an experienced Big Data Engineer to join our team at Oracle. This role involves designing, developing, and troubleshooting large-scale data systems.Key ResponsibilitiesDesign and implement data processing pipelines using Big Data technologiesDevelop and maintain large-scale data storage systemsCollaborate with cross-functional teams...


  • Bengaluru, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...


  • Bengaluru, Karnataka, India Walmart Global Tech India Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at Walmart Global Tech India. As a key member of our engineering team, you will play a critical role in designing, building, and deploying cutting-edge big data solutions that drive business value for our customers.

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India LTIMindtree Full time

    About UsLTIMindtree is a leading global technology consulting and services company, helping customers reimagine their businesses for the digital age. We have expertise in big data analytics.Job OverviewWe are seeking a skilled Data Engineer - Big Data Analytics to join our team. The successful candidate will be responsible for designing, developing, and...


  • Bengaluru, Karnataka, India GForce Consulting Solutions (OPC) Pvt. Ltd. Full time

    Senior Software EngineerGForce Consulting Solutions (OPC) Pvt. Ltd., a leading global IT services company, is seeking an experienced Senior Software Engineer for our Multinational Client.About the RoleThis role involves working with our client to design and develop cutting-edge big data solutions using AWS Data Bricks, S3, Redshift, EC2, Lambda, Azure data...


  • Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...

  • Data Engineer

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302683 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Off Shore) - Big ID to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Big Data Engineer

    5 months ago


    Bengaluru, India Infogain Full time

    Big Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...

  • Big data engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...

  • Big Data Engineer

    6 months ago


    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...


  • Bengaluru, Karnataka, India Wipro Full time

    Job SummaryWe are seeking an Expert Big Data Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a senior-level position that requires excellent knowledge of Spark, Scala, and PySpark. You...