Big Data Platform Engineer

4 weeks ago

hyderabad, India Apple Full time
Summary:
The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it.The Global Business Intelligence team provides data services, analytics, reporting, and data science solutions to Apple’s business groups, including Retail, iTunes, Marketing, AppleCare, Operations, Finance, and Sales. These solutions are built on top of a great data platform and leverage multiple frameworks. This position is an extraordinary opportunity for a competent, experienced, and driven Big Data platform engineer to define and build some of the best-in-class data platforms and products
Key Qualifications:
4+ years of experience in building and managing big data platforms and programming experience in Java, Scala or Python In-depth knowledge of Spark, Ray or other distributed computing frameworks Understanding of SQL query engines like Trino, Hive etc. Experience with Docker, Kubernetes or EKS Experience with debugging issues on distributed systems. Knowledge of software engineering practices and standard methodologies for the full software development lifecycle Experience with public cloud (AWS/GCP) Have created frameworks to deploy platforms in AWS/Azure/GCP. Good understanding of AI/ML stack - GPUs, MLFlow, LLM models is plus. Experience in building, tuning, scaling, and monitoring applications to process real-time, near-real-time and batch data Understanding of data modeling, data warehousing, and ETL concepts is a plus
Description:
The GBI Big Data Engineering team is responsible for building and managing data platforms at scale on Cloud, that help Apple process, store and access petabytes of data. We’re looking for a Big Data Engineer with strong understanding of big data and ML platforms, passionate about building and managing cloud infrastructure and can demonstrate to Apple’s high standards. As a part of our team, you’ll be responsible for building and integrating various compute and storage infrastructure using open source or other solutions to aid various critical applications, such as analytic, reporting, AI/ML apps. Additionally, you will be deploying cloud stacks supporting big data and AI/ML platforms, locating production errors and issues. You are able to communicate effectively, both written and verbal, with technical and non-technical multi-functional teams. You will interact with many other teams to lead and deliver best-in-class products in an exciting fast-paced environment. Dynamic, inquisitive people and inspiring, innovative technologies are the norm here. Will you join us in crafting solutions that do not yet exist?
Additional Requirements:

  • Sr. Big Data Platform Engineer, SMAI

    6 days ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR53957 Sr. Big Data Platform Engineer, SMAIDo you believe...

  • Sr. Big Data Platform Engineer, SMAI

    7 days ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR53957 Sr. Big Data Platform Engineer, SMAI Do you...

  • Sr. Big Data Platform Engineer, SMAI

    6 days ago

    hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR53957 Sr. Big Data Platform Engineer, SMAI Do...

  • Big data lead engineer

    5 days ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 DescriptionPosition: Big data engineerPrimary skills: Big data, Pyspark, AWSLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Big data lead engineer

    1 week ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...

  • Big data lead engineer

    1 week ago

    hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big Data Engineer

    3 weeks ago

    Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:- This position will be part of a growing team working towards building world class large scale Big Data architectures.- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location - Bangalore and...

  • Big Data Engineer

    3 weeks ago

    Bangalore,Hyderabad, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:- This position will be part of a growing team working towards building world class large scale Big Data architectures.- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location - Bangalore and...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, India TechSophy Full time

    Job Description:Roles&Responsibilities :1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into the data...

  • Senior Azure Data Engineer

    3 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Lead Big Data Software Engineer

    4 weeks ago

    Hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Senior Big Data Software Engineer

    4 weeks ago

    Hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Senior Big Data Software Engineer

    3 weeks ago

    Hyderabad, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map. 2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Big Data Engineer

    4 weeks ago

    hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Senior Azure Data Engineer

    4 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    4 weeks ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Data Engineer

    4 weeks ago

    Hyderabad, India Zallery Full time

    Job Description : - Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions - Strong programming skills in languages like Python, Java, or Scala - Experience with big data technologies (Hadoop, Spark) ETL tools, and data warehousing solutions - Proficiency in both relational and NoSQL database - Solid...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data EngineerSpecification-• 2 – 7 years of recent experience indata engineering.• Bachelor's Degree or more in ComputerScience or a related field.• A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in , Spark,...

  • Big Data Engineer

    4 weeks ago

    hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data Engineer  Specification- • 2 – 7 years of recent experience indata engineering. • Bachelor's Degree or more in ComputerScience or a related field. • A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in ,...