Big Data Engineer

1 week ago

Bangalore, India Adobe Full time

JOB LEVEL

P50

EMPLOYEE ROLE

Individual Contributor

P50 (ESDEP50)  Big Data Engineer  

 

What Youâll Do 

  • Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective.
  • Translate complex technical and functional requirements into detailed designs.
  • Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders. 
  • Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.â
  • Handle project scope and risks with data, analytics, and creative problem-solving.
  • Help define data governance policies and implement security and privacy guard rails.

 

 

What you require:

 

  • Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets
  • Understanding of data-warehousing and data-modelling techniques
  • Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus. 
  • Proficient in some of the following tools and technologies:
    • Languages: Python, Java/Scala, SQL
    • Dev-ops pipelines
    • Container orchestration: Docker, Kubernetes
    • Hadoop ecosystem: Hadoop, Spark, Hive etc.
    • Stream processing: Storm, Flink etc.
    • Workflow: Airflow, Flyte, etc.
    • Data Engineering ecosystem: DeltaLake, DataHub etc.
  • General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
  • Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets

 

 

 

 

 

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or B.Tech in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders. 

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

Internal Opportunities

Creativity, curiosity, and constant learning are celebrated aspects of your career growth journey. Weâre glad that youâre pursuing a new opportunity at Adobe

Put your best foot forward:

1. Update your Resume/CV and Workday profile â donât forget to include your uniquely âAdobeâ experiences and volunteer work.

2. Visit the Internal Mobility page on Inside Adobe to learn more about the process and set up a job alert for roles youâre interested in.

3. Check out these tips to help you prep for interviews.

4. If you are applying for a role outside of your current country, ensure you review the International Resources for Relocating Employees on Inside Adobe, including the impacts to your Benefits, AIP, Equity & Payroll. 

Once you apply for a role via Workday, the Talent Team will reach out to you within 2 weeks. If you move into the official interview process with the hiring team, make sure you inform your manager so they can champion your career growth.

At Adobe, you will be immersed in an exceptional work environment that is recognized around the world. You will also be surrounded by colleagues who are committed to helping each other grow through our unique Check-In approach where ongoing feedback flows freely. If youâre looking to make an impact, Adobe's the place for you. Discover what our employees are saying about their career experiences on the Adobe Life blog and explore the meaningful benefits we offer.

Adobe is an equal opportunity and affirmative action employer. We welcome and encourage diversity in the workplace regardless of  gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other characteristics protected by law.

If you have a disability or special need that requires accommodation to navigate our internal careers site or to complete the application process, please contact accommodations@adobe.com.

  • Big Data Engineer

    4 weeks ago

    bangalore, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big data engineer

    2 days ago

    bangalore, India Virtusa Full time

    Big data engineer - CREQ191311 Description Position: Big data engineer Primary skills: Big data, hadoop, pyspark Location: Hyderabad &BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging...

  • Big Data Engineer

    3 days ago

    bangalore, India NetApp Full time

    Title: Big Data Engineer Location: Bangalore, Karnataka, IN, 560071 Requisition ID: 126725 Job Summary As a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled...

  • Big Data Engineer

    7 days ago

    bangalore, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago

    bangalore, India Alp Consulting Limited Full time

    Big Data Engineer Duties & Responsibilities To write an effective big data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included big data engineer job description templates that you can modify and use. Sample responsibilities for this position include: You are responsible for Hadoop...

  • Big Data Engineer

    7 days ago

    bangalore, India Alp Consulting Limited Full time

    Senior Big Data Engineer Duties & Responsibilities To write an effective senior big data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included senior big data engineer job description templates that you can modify and use. Sample responsibilities for this position include: Performing...

  • Big Data Engineer

    1 week ago

    bangalore, India shreeniwas Full time

    Big Data Engineer Job Description: Data Scientist We are looking for a candidate with 6+ years of experience as a DATA ENGINEER, with education (Bachelors degree or higher) in Computer Science, Mathematics, or a related technical field, or equivalent practical experience. They should also have the following abilities: Required 1. Relevant Experience...

  • Solution Engineer

    5 days ago

    Bangalore, India Coders Brain Technology & Private Limited Full time

    Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Big Data-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand requirements, configureand implement our...

  • Solution Engineer

    1 week ago

    bangalore, India Coders Brain Technology & Private Limited Full time

    Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Big Data-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand requirements, configureand implement our...

  • Solution Engineer

    6 days ago

    Bangalore, Karnataka, India Coders Brain Technology & Private Limited Full time

    Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Big Data-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand requirements, configureand implement our...

  • Big Data Engineer

    2 weeks ago

    Mumbai/Pune/Bangalore, India Techno Wise Full time

    Job Description :We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    1 month ago

    bangalore, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon ...

  • Big Data Engineer

    2 weeks ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big data Manager

    1 day ago

    Bengaluru/ Bangalore, India timesjobs Full time

    JOB DETAILS1.Experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)2.Hands-on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: June 04, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    3 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: July 02, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Manager - Big Data

    2 weeks ago

    bangalore, India Magnus India Consulting Services Full time

    About the Company:Opportunity with one of the leading Media & Entertainment players for a role in Big Data.About the Role:The incumbent will direct the development and implementation of Big data and analytics solutions.Experience - 9+ yearsIndustry - Product based companiesLocation - Bangalore (Work from Office)Responsibilities:Hands-on implementation role...

  • Azure Big Data Engineer

    4 weeks ago

    bangalore, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our + tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...