See more Collapse

Big Data Engineer

2 months ago

bangalore, India Adobe Full time

Our Company
Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. 
We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours

What You’ll Do 

Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex technical and functional requirements into detailed designs. Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.  Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.​ Handle project scope and risks with data, analytics, and creative problem-solving. Help define data governance policies and implement security and privacy guard rails.

What you require:

Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets Understanding of data-warehousing and data-modelling techniques Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus.  Proficient in some of the following tools and technologies: Languages: Python, Java/Scala, SQLDev-ops pipelinesContainer orchestration: Docker, KubernetesHadoop ecosystem: Hadoop, Spark, Hive processing: Storm, Flink etc.Workflow: Airflow, Flyte, Engineering ecosystem: DeltaLake, DataHub etc. General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders. 

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

We have other current jobs related to this field that you can find below

  • Big Data Engineer

    1 month ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    4 days ago

    bangalore, India Alp Consulting Limited Full time

    Big Data Engineer Duties & Responsibilities To write an effective big data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included big data engineer job description templates that you can modify and use. Sample responsibilities for this position include: You are responsible for Hadoop...

  • Big Data Engineer

    5 days ago

    Mumbai/Pune/Bangalore, India Techno Wise Full time

    Job Description :We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...

  • Big Data Engineer

    2 months ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon ...

  • Big Data Engineer

    5 days ago

    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Thomson Reuters Full time

    Big Data EngineerThe ideal candidate should be able to demonstrate strong technical aptitude and interest in learning new technologies.In this role you will work closely with our Big Data technical lead to deliver a set of Big Data services to Thomson Reuters product teams.About the RoleIn this opportunity as, Big Data Engineer, you will:  Work closely...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: June 04, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: June 02, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: June 03, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    3 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 31, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    2 months ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...