Big Data Engineer

2 days ago

Bengaluru, India Adobe Full time

Our Company

Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. 

We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours

P50 ( ESDEP50) Big Data Engineer

What You’ll Do 

Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex technical and functional requirements into detailed designs. Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.  Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.​ Handle project scope and risks with data, analytics, and creative problem-solving. Help define data governance policies and implement security and privacy guard rails.

What you require:

Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets Understanding of data-warehousing and data-modelling techniques Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus.  Proficient in some of the following tools and technologies: Languages: Python, Java/Scala, SQLDev-ops pipelinesContainer orchestration: Docker, KubernetesHadoop ecosystem: Hadoop, Spark, Hive processing: Storm, Flink etc.Workflow: Airflow, Flyte, Engineering ecosystem: DeltaLake, DataHub etc. General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders. 

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position.Job Title: Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote positionJob Title:Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and fintech ka experience MUST.Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    This is a remote positionDuration:6 MonthLocation:RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 YearsResponsibilitiesCreate and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESResponsibilities:Strong experience of minimum 5+ years in Snowflake & Snowpipe having over all 9 to 12 years of experience as a data engineer, database developer, or similar...

  • Big Data Engineer

    8 hours ago

    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities : Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem Utilize Scala programming language to implement efficient data processing solutions Collaborate with crossfunctional teams to understand data requirements and deliver optimal solutions Implement best practices for...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: June 07, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities: Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESStrong experience of 9 to 12 years as a data engineer, database developer, or similar role, focusing on data warehousing and analytics.Minimum 5 years of experience in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES Strong experience ofoverall 9 to 12 yearsof experience as a data engineer, database developer, or...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Thoucentric Full time

    Job Description:As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • big data engineer

    2 weeks ago

    Bengaluru, Karnataka, India Techno Wise Full time

    Apply for BIG DATA ENGINEER, Techno Wise in Bengaluru/ Bangalore ,Mumbai ,Pune for 4 - 8 Year of Experience on