Data Engineer II

21 hours ago


Pune, Maharashtra, India TripleLift Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About TripleLift

We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionable data and smart targeting. Through over 1 trillion monthly ad transactions, we help publishers and platforms monetize their businesses. Our technology is where the world's leading brands find audiences across online video, connected television, display and native ads. Brand and enterprise customers choose us because of our innovative solutions, premium formats, and supportive experts dedicated to maximizing their performance.

As part of the Vista Equity Partners portfolio, we are NMSDC certified, qualify for diverse spending goals and are committed to economic inclusion. Find out how TripleLift raises up the programmatic ecosystem at


The Role

TripleLift is seeking a Data Engineer II to join a small, influential Data Engineering team. You will be responsible for evolving and optimizing our high-volume, low-latency data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. In this role, you will support our software engineers, product managers, business intelligence analysts, and data scientists on data initiatives. You will also ensure optimal data delivery architecture is applied consistently across all new and ongoing projects. Ideal candidates will be self-starters who can efficiently meet the data needs of various teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

Responsibilities:
  • Create and maintain optimal, high-throughput data platform architecture handling 100's of billions of daily events.
  • Explore, refine and assemble large, complex data sets that meet functional product and business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, EMR, Snowpark, Kafka and other big data technologies
  • Work with stakeholders across geo-distributed teams, including product managers, engineers and analysts to assist with data-related technical issues and support their data infrastructure needs.
  • Digest and communicate business requirements effectively to both technical and non-technical audiences.
Qualifications:
  • 2+ years of experience in a Data Engineer role
  • Bachelors Degree, or higher, in Computer Science or related Engineering field
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets
  • Strong working knowledge of Databricks/Spark and associated APIs
  • Experience with object-oriented and functional scripting languages: Python, Java, Scala and associated toolchain
  • Experience working with relational databases, SQL authoring/optimizing as well as operational familiarity with a variety of databases.
  • Experience with AWS cloud services: EC2, EMR, RDS
  • Experience working with NoSQL data stores such as: Elasticsearch, Apache Druid
  • Experience with data pipeline and workflow management tools: Airflow
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
  • Strong experience working with unstructured and simi-structured data formats: JSON, Parquet, Iceberg, Avro, Protobuf
  • Expert knowledge of processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Proven experience in manipulating, processing, and extracting value from large, disparate datasets.
  • Working knowledge of streams processing, message queuing, and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
Preferred:
  • Streaming systems experience with Kafka, Spark Streaming, Kafka Streams
  • Snowflake/Snowpark
  • DBT
  • Exposure to AdTech

Life at TripleLift

At TripleLift, we're a team of great people who like who they work with and want to make everyone around them better. This means being positive, collaborative, and compassionate. We hustle harder than the competition and are continuously innovating.

Learn more about TripleLift and our culture by visiting our LinkedIn Life page.

Establishing People, Culture and Community Initiatives

At TripleLift, we are committed to building a culture where people feel connected, supported, and empowered to do their best work. We invest in our people and foster a workplace that encourages curiosity, celebrates shared values, and promotes meaningful connections across teams and communities. We want to ensure the best talent of every background, viewpoint, and experience has an opportunity to be hired, belong, and develop at TripleLift. Through our People, Culture, and Community initiatives, we aim to create an environment where everyone can thrive and feel a true sense of belonging.

Privacy Policy

Please see our Privacy Policies on our TripleLift and 1plusX websites.

TripleLift does not accept unsolicited resumes from any type of recruitment search firm. Any resume submitted in the absence of a signed agreement will become the property of TripleLift and no fee shall be due.


  • Software Engineer II

    2 weeks ago


    Pune, Maharashtra, India Mastercard Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Software Engineer II

    24 hours ago


    Pune, Maharashtra, India Mastercard Full time ₹ 5,00,000 - ₹ 10,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...


  • Pune, Maharashtra, India Mastercard Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Our PurposeTitle and SummarySoftware Engineer II - Automation Testing & Java Coding Software Engineer II in Test Quality Engineering Overview Quality Engineering team within MasterCard is about creating an ecosystem to build a world beyond waiting for all delivery teams to help achieve time-to-market, software engineering excellence, and higher customer...

  • Software Engineer II

    2 weeks ago


    Pune, Maharashtra, India Mastercard Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...


  • Pune, Maharashtra, India Mastercard Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Overview :The Distributed Platform organization at Mastercard is looking for a System Platform Engineer II. The System Platform Engineer II will have proven experience implementing server-based solutions. The position includes skills in automation, deployment, and maintaining the lifecycle of the platform. The Systems Platform Engineer II is mostly focused...


  • Pune, Maharashtra, India Mastercard Full time US$ 1,00,000 - US$ 2,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Data Engineer II

    4 days ago


    Pune, Maharashtra, India Zendesk Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job DescriptionData EngineerOur Enterprise Data & Analytics (EDA) is looking for a Data Engineer to join our growing data engineering team. We are a globally distributed remote first team. You'll work in a collaborative Agile environment using the latest engineering best practices with involvement in all aspects of the software development lifecycle. You...

  • R&D Engineer II

    7 days ago


    Pune, Maharashtra, India Synopsys Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Summary/Role PurposeThe R&D Engineer II joins the Global CTO Office, contributes/leads the research, design and development of next-generation software products/support systems while working on innovative technologies including AI/ML/, System Engineering, MBSE (Model Based Systems Engineering), Digital Twins, IOT (Hardware/Software) etc.In this role, the R&D...

  • Software Engineer II

    2 weeks ago


    Pune, Maharashtra, India Blueshift Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About UsBlueshift is a venture-funded startup headquartered in San Francisco. Our AI-Powered marketing platform empowers cutting edge B2C brands to drive 1:1 marketing on every channel. With Blueshift, marketers are in full control of automating various forms of personalised messaging across every engagement channel. Blueshift is trusted by leading digital...

  • Data Engineer II

    1 week ago


    Pune, Maharashtra, India Zendesk Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job DescriptionData EngineerOur Enterprise Data & Analytics (EDA) is looking for a Data Engineer to join our growing data engineering team. We are a globally distributed remote first team. You'll work in a collaborative Agile environment using the latest engineering best practices with involvement in all aspects of the software development lifecycle. You...