Big Data Engineer

6 months ago

Bengaluru, India Adobe Full time

Our Company

Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. 

We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours

P50 ( ESDEP50) Big Data Engineer

What You’ll Do 

Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex technical and functional requirements into detailed designs. Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.  Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.​ Handle project scope and risks with data, analytics, and creative problem-solving. Help define data governance policies and implement security and privacy guard rails.

What you require:

Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets Understanding of data-warehousing and data-modelling techniques Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus.  Proficient in some of the following tools and technologies: Languages: Python, Java/Scala, SQLDev-ops pipelinesContainer orchestration: Docker, KubernetesHadoop ecosystem: Hadoop, Spark, Hive processing: Storm, Flink etc.Workflow: Airflow, Flyte, Engineering ecosystem: DeltaLake, DataHub etc. General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders. 

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Wipro Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Wipro. This is a fantastic opportunity for individuals with expertise in designing, building, and maintaining large-scale data processing systems.About the Role:The ideal candidate will have hands-on experience with big data technologies such as Hadoop, Spark, and Kafka. You...

  • Big Data Engineer

    5 months ago

    Bengaluru, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...

  • Cloud Data Engineer for Big Data Processing

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...

  • Big data Engineer

    2 weeks ago

    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big data engineer

    4 weeks ago

    Bengaluru, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:..4Veröffentlichungsdatum:..4Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory: Deep hands-on...

  • Big Data Engineer 3

    4 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Job SummaryWe are seeking an experienced Big Data Engineer to join our team at Oracle. This role involves designing, developing, and troubleshooting large-scale data systems.Key ResponsibilitiesDesign and implement data processing pipelines using Big Data technologiesDevelop and maintain large-scale data storage systemsCollaborate with cross-functional teams...

  • Big Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Absolutdata Full time

    Location : Noida/BangaloreExperience : 4 – 8 YearsIn today's data-driven world, organizations rely on skilled professionals to unlock the power of big data. As a Data Engineer at Absolutdata, you will play a vital role in building the big data infrastructure, driving business growth, and delivering actionable insights.Key ResponsibilitiesDesign and...

  • Big Data Engineer/Architect

    5 months ago

    Bengaluru, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...

  • Big Data Engineer Specialist

    1 day ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...

  • Big Data Engineering Expert

    3 weeks ago

    Bengaluru, Karnataka, India Walmart Global Tech India Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at Walmart Global Tech India. As a key member of our engineering team, you will play a critical role in designing, building, and deploying cutting-edge big data solutions that drive business value for our customers.

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    About UsLTIMindtree is a leading global technology consulting and services company, helping customers reimagine their businesses for the digital age. We have expertise in big data analytics.Job OverviewWe are seeking a skilled Data Engineer - Big Data Analytics to join our team. The successful candidate will be responsible for designing, developing, and...

  • Big Data Developer

    2 months ago

    Bengaluru, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required:5+ yearsEmployment Type:Full-timeEmployment Mode:HybridLocation:Bangalore, Pune, Trivandrum.Industry:Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Mercedes-Benz Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Mercedes-Benz Research and Development India Private Limited. The ideal candidate will have deep expertise in Databricks, Python, and SQL queries, as well as experience in designing and implementing Big Data technologies.Key ResponsibilitiesDesign and implement Big Data...

  • Lead Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India GForce Consulting Solutions (OPC) Pvt. Ltd. Full time

    Senior Software EngineerGForce Consulting Solutions (OPC) Pvt. Ltd., a leading global IT services company, is seeking an experienced Senior Software Engineer for our Multinational Client.About the RoleThis role involves working with our client to design and develop cutting-edge big data solutions using AWS Data Bricks, S3, Redshift, EC2, Lambda, Azure data...

  • Data Engineer for Big Data Pipelines

    19 hours ago

    Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Eximietas Design Full time

    6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...

  • Big data developer

    1 month ago

    Bengaluru, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ yearsEmployment Type: Full-timeEmployment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in Py Spark and Big Data platforms to join our growing team. The ideal candidate will have...

  • Big Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Weekday Full time

    About the RoleThis position at Weekdays is designed to support the company's growth in data-driven solutions. The ideal candidate will possess expertise in programming languages such as Java, Python, or Scala, and have a strong background in Big Data technologies including Hadoop, MapReduce, Spark, HBase, and Elasticsearch.ResponsibilitiesWork as a skilled...

  • Big Data Engineer

    4 months ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...

  • Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302683 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Off Shore) - Big ID to join our team in Bangalore, Karnātaka (IN-KA), India...