Big Data Software Engineer

2 weeks ago


Bengaluru, Karnataka, India Apple Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you'll do more than join something - you'll add something. As a BigData Software Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple's products and modules worldwide. Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you.

Description

As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects. - Lead the design and implementation of cloud-based data architectures. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. - Implement data security and privacy best practices. - Optimize data storage, retrieval, and processing for performance and cost efficiency. - Lead efforts to ensure data quality, consistency, and accuracy. - Mentor and provide technical guidance to junior data engineers. - Stay current with industry trends and emerging technologies in cloud data engineering.

Minimum Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field
  • Proven experience as a Big Data developer, with a focus on cloud platforms
  • Strong proficiency in cloud services such as AWS, Azure, or Google Cloud
  • Expertise in data modelling and data integration
  • Experience with big data technologies (Hadoop, Spark, etc.)
  • Proficient in programming languages such as Python, Java, Scala, GoLang
  • Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid)
  • Experience with streaming data technologies (Kafka, Kinesis)

Preferred Qualifications

  • Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)
  • Experience building data streaming solutions using Apache Spark, Storm, Link, Flume
  • Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas
  • Knowledge of machine learning and data science concepts
  • Contributions to the open source community
  • Familiarity with data governance and compliance
  • Strong problem-solving and analytical skills
    Excellent communication and leadership skills

Submit CV


  • Big Data Engineer

    1 day ago


    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...

  • Big Data Engineer

    5 days ago


    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Akshya Patra Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Big Data Engineer with expertise in various Big Data tools and ecosystems. The ideal candidate should have hands-on experience with technologies such as Hadoop, Spark, Hive, and Impala. A strong proficiency in programming languages like Scala, Java, and Python is essential for designing and implementing data processing...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...

  • Data Engineer

    7 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...


  • Bengaluru, Karnataka, India Innova ESI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Big Data + Azure EngineerLocation: BangaloreExperience: 12+ yearsNotice: ImmediateJob Description:Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including...

  • Big Data Developer

    1 day ago


    Bengaluru, Karnataka, India Sourcebae Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...


  • Bengaluru, Karnataka, India Allstate Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing...

  • Big Data Engineer

    5 days ago


    Bengaluru, Karnataka, India First Due Solutions Full time ₹ 24,00,000 per year

    Job DescriptionExperience 5 - 8 yrsMode of Working - Hybrid (3 days WFO, 2 days WFH)Location - Bangalore / Pune / Hyderabad.Bangalore / Pune / Hyderabad.Big Data DeveloperFocus: Building applications and solutionsWrites code and develops software applications that process big dataCreates data-driven applications and analytical toolsFocuses on implementing...

  • Big Data Developer

    2 weeks ago


    Bengaluru, Karnataka, India ITC Infotech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Required Skills:Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python.Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS.Ability to handle data integration, bug fixing, performance optimization, and feature enhancements for distributed data pipelines.Having experience with...