Big Data Engineer

4 months ago

Bengaluru, India Adobe Full time

Our Company

Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. 

We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours

P50 ( ESDEP50) Big Data Engineer

What You’ll Do 

Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex technical and functional requirements into detailed designs. Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.  Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.​ Handle project scope and risks with data, analytics, and creative problem-solving. Help define data governance policies and implement security and privacy guard rails.

What you require:

Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets Understanding of data-warehousing and data-modelling techniques Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus.  Proficient in some of the following tools and technologies: Languages: Python, Java/Scala, SQLDev-ops pipelinesContainer orchestration: Docker, KubernetesHadoop ecosystem: Hadoop, Spark, Hive processing: Storm, Flink etc.Workflow: Airflow, Flyte, Engineering ecosystem: DeltaLake, DataHub etc. General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders. 

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We help clients innovate, optimize, and transform for long-term success. Our diverse experts in over 50 countries and robust partner ecosystem enable us to deliver cutting-edge solutions.Job DescriptionWe are seeking a skilled Data Engineer...

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Krishpar Technologies Pvt. Ltd Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a highly skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have expertise in Hadoop, Hive, and other big data technologies. Key Responsibilities:Design and implement big data solutions using Hadoop, Hive, and other relevant technologies.Develop and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday Full time

    Job Title: Big Data EngineerThis role is for a talented Big Data Engineer to join our team at Weekdays. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Elasticsearch.Responsibilities:Design and develop scalable...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Weekday Full time

    Job Title: Big Data EngineerAbout the Role:We are seeking a highly skilled Big Data Engineer to join our team at Weekday. As a key member of our engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Elasticsearch.Key Responsibilities:*...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday Full time

    Job Title: Big Data EngineerThis role is for a talented Big Data Engineer to join our team at Weekdays. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Elasticsearch.Responsibilities:Design and develop scalable...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Job Title: Big Data EngineerJob Description:We are seeking a skilled Big Data Engineer to join our team at TapTalent. The ideal candidate will have hands-on experience with Big Data, Hadoop, and GCP, as well as strong knowledge of PySpark, Python, and Scala.Key Responsibilities:Design and implement data services using GCPWork with large datasets using Big...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role: Big Data EngineerKey Responsibilities:Design and develop scalable big data architectures using Hadoop and SparkImplement data processing pipelines using Scala and SparkCollaborate with cross-functional teams to deliver data-driven insightsRequirements:5+ years of experience in big data engineeringStrong knowledge of Hadoop, Spark, Scala, and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    About AdobeAt Adobe, we're passionate about empowering people to create and deliver exceptional digital experiences. Our mission is to give everyone the tools they need to design, build, and deliver innovative solutions that transform the way companies interact with customers across every screen.Job SummaryWe're seeking a highly skilled Big Data Engineer to...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Hexaware Technologies Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Hexaware Technologies. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems.Key Responsibilities:Design and develop data processing systems using big data technologies such as Hadoop,...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    About AdobeAt Adobe, we're passionate about empowering people to create and deliver exceptional digital experiences. We're a company that's all about innovation, creativity, and making a difference in the world. We're looking for talented individuals who share our passion and want to join our team of innovators.Job SummaryWe're seeking a highly skilled Big...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TekPillar Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TekPillar. The ideal candidate will have a strong background in big data technologies, including Hadoop, Hive, and Spark, as well as experience with programming languages such as Scala, Python, and SQL.Key Responsibilities:Design and develop...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Job Description:Company: TapTalentYears of experience: 7-12 yearsLocation: Bangalore, ChennaiBudget: As per company normsNotice Period: Immediate/ ServingWork Model: WFOJob Type: PermanentKey Responsibilities:We are seeking a highly skilled Data Engineer with hands-on experience in Big Query, DataProc, Airflow, Cloud Composer, and GCP Hydra Services. The...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Nielsen Full time

    About NielsenWe are a leading global information and measurement company, providing insights that drive business decisions and deliver extraordinary results. Our talented workforce is dedicated to capturing audience engagement with content - wherever and whenever it's consumed.Job SummaryWe are seeking a highly skilled Big Data Engineer to join our team. As...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    About the RoleWe're seeking a highly skilled Big Data Engineer to join our team at Adobe. As a Big Data Engineer, you will be responsible for building and maintaining our data platform, leveraging best-in-class technologies to drive innovation and efficiency.Key ResponsibilitiesDesign and implement data processing pipelines using cutting-edge...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Société Générale Assurances Full time

    Job Title: Specialist Software Engineer(Big Data)Job Summary:We are seeking a highly skilled Specialist Software Engineer(Big Data) to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies.Responsibilities:Design and develop...

  • Big Data Engineer

    4 months ago

    Bengaluru, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Job Description:Company: TapTalentRole: Big Data EngineerYears of experience: 7-12 yearsLocation: RemoteBudget: CompetitiveNotice Period: ImmediateWork Model: WFOJob Type: PermanentTapTalent is seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have hands-on experience with Big Data technologies such as Hadoop, Spark, and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Hexaware Technologies Full time

    Job Title: Big Data DeveloperHexaware Technologies is seeking a highly skilled Big Data Developer to join our team. As a key member of our analytics team, you will be responsible for designing and developing distributed data systems, coding, testing, and documenting new or modified data systems to create robust and scalable applications for data...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India ATech Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at ATech. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing our data infrastructure to support our growing data-driven organization.Key Responsibilities:Design and implement scalable data pipelines using...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India ACL Digital Full time

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at ACL Digital. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines, working with stakeholders to identify business requirements, and collaborating with data scientists to develop and...