Data Engineer

2 months ago

Tirupati, India Epsilon Full time

Company Description:

When you’re one of us, you get to run with the best. For decades, we’ve been helping marketers from the world’s top brands personalize experiences for millions of people with our cutting-edge technology, solutions, and services. Epsilon’s best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, messaging, and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon India is now a Great Place to Work-Certified™. Epsilon has also been consistently recognized as industry-leading by Forrester, Adweek, and the MRC. Positioned at the core of Publicis Groupe, Epsilon is a global company with more than 8,000 employees around the world. For more information, visit epsilon.com/apac or our page.


This includes one Face-to-face round discussion, so we are only looking for Bangalore-based candidates and also we are only looking out for immediate joiners or who is Serving Notice period and whose LWD is about to end


Job Description

Organization Objective/Purpose:

This role is part of the Data Engineering Team, within the Digital Experience organization. The team’s core objective is to drive business growth and deepen client relationships by transforming how Epsilon’s customers use and maximize their investments around marketing data needs. As a software engineer in our fast-moving, small entrepreneurial team, you will develop segmentations required for marketing needs. You will be responsible for solving technical challenges and delivering the project needs. We are passionate, client-centric, business leaders who seek to deliver meaningful revenue-generating and cost-saving results.


Brief Description of Role:

Delivering integrated marketing solutions focused on relevant, personalized, and cross-channel technologies is paramount at Epsilon. This position will focus on development and integration of data onto multiple CDP platforms. The communication skill to understand the business requirement, walk through the complex design with simple examples, demonstrate why the system is working and clarify the performance outcome with the customer is equally important.

This is a highly visible position directly working with Epsilon’s client base. We are looking for a development professional to manage this initiative and important opportunity.

You will need to be able to work in a cross matrix team environment from both Epsilon and our client base including; peer developers, project managers, systems analyst, database developers, marketing teams, business managers, and executive leadership. Work closely for all IT development and integration work with the client. Implement critical processes needs for the client. Prepare and maintain documentation including planning, analysis, design, implementation/testing, and deployment deliverables. Execute as per timelines and coordination among sub-projects; ensure that cross-project dependencies are identified, communicated, and tracked. Refine and implement quality test plans.


Technical/Functional Qualifications:

This position requires an individual with a combination of data engineering and analytical skills with the desire towards being part of cutting-edge, high-profile projects and is motivated by delivering world-class solutions on an aggressive schedule. The candidate should have a solid foundation in computer science with well-honed skills in data engineering.


We are looking for an experienced Azure data engineer who will develop and build a marketing data mart for a major pharmaceutical company in the market.


  • Should have a comprehensive understanding of services on the Azure data platform
  • Supports ADF pipelines – Builds the required dimensions, rules, segments, and aggregates
  • Having good experience in ETL processing
  • Having experience in writing SQL queries is a must
  • Support all database operations: performance monitoring, pipeline ingestion, maintenance, etc.
  • Experience in Pyspark programming is a must
  • Develop new inbound data sources required within the Marketing Data Mart to support campaign creation
  • Monitor DataMart health - data loads, extracts, failures, performance tuning
  • Create/modify data structures/pipelines
  • Knowledge of Salesforce Marketing Cloud and Tealium CDP platforms will be an added advantage
  • Supports daily processing, monitoring, and loading for all data updates
  • Always consider all software best practices. Ex. infrastructure cost, security, scalability, feature extensibility, ease of maintenance, etc.
  • Develop, document, and test software and environment setup to ensure that the outcome meets the needs of end-users and achieves business goals
  • Work with various business and technical people to understand the systems, data sources, business goals, technical goals, and timelines on multiple projects


Qualifications

The following are required:

  • Strong analytical, written and verbal communication skills.
  • Tech Stack: ADF pipeline, Databricks, Pyspark, SQL, PL-SQL, SSIS
  • Develop Azure logic apps
  • Strong Experience in development of Azure Datalake solutions
  • Must have experience in developing serverless applications using Azure function apps
  • Experience with Azure Data Factory, Databricks, Spark, or other cloud ETL technologies preferred.
  • Experience in designing and building data ingestion pipelines both real-time and batch using best practices
  • Connect to different source systems and collect the data in scheduled time and process them using different components like Azure Data bricks, Function Apps, Logic apps etc., and distribute it to the downstream systems.
  • Knowledge in setting up automated test suites for ETL pipelines
  • Experience setting up CI/CD pipelines for ETL projects
  • Attention to detail in design, documentation and test coverage of what you build
  • Collaborate with business stakeholders to identify and meet data requirements.
  • Familiarity with software development methodology such as Agile/Scrum/Kanban
  • Implementing incremental data load
  • Strong experience in SQL analytic queries
  • Knowledge on any of the CDP platforms will be an added advantage.


In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.

  • Senior Data Engineer

    4 weeks ago

    Tirupati, India ValueLabs Full time

    Dear Aspirants,We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same.Role: Sr Data EngineerExperience: 5+ YearsPreferable Immediate JoinersThe Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role requires...

  • Snowflake Data Engineer

    3 weeks ago

    Tirupati, India Nice Software Solutions Pvt. Ltd. Full time

    Job Title: Snowflake Data EngineerExperience: 4 to 8 YearsLocation: Nagpur / PuneJob Summary:We are seeking a skilled Snowflake Data Engineer with 4 to 8 years of experience in data engineering. The ideal candidate will have a strong background in Python, Snowflake, and SQL to design, build, and maintain scalable data pipelines and data solutions.Key...

  • Data Ops Engineer

    15 hours ago

    Tirupati, India Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python.12+ years in data and software engineering.Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory).Strong understanding of DevOps, DataOps, and product management.Experience with Agile...

  • Azure Data Engineer

    2 weeks ago

    Tirupati, Andhra Pradesh, India Antal TECH jobs Full time

    Job Title: Senior Azure Data EngineerAt Antal TECH jobs, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data ingestion pipelines...

  • Lead Data Science Engineer

    2 months ago

    tirupati, India ImageVision.ai Full time

    **Company Overview:** We help our customers in solving the toughest business problems using image analytics and video analytics. Our team has strong technical expertise in object classification, feature recognition, segmentation, pattern recognition, object detection, filtering etc. to address the business challenges of diverse industries. Our...

  • Data Scientist

    3 weeks ago

    Tirupati, India Young Minds Technology Solutions Pvt Ltd Full time

    Data Preprocessing: Perform data preprocessing and feature engineering to ensure the quality, relevance, and suitability of data for modeling purposes. - NLP Expertise: Possess practical experience and expertise in Natural Language Processing (NLP) techniques and frameworks to work on NLP-related projects effectively. - Model Building: Design, develop, and...

  • Data Scientist

    2 months ago

    Tirupati, India STRYDO TECHNOLOGIES PVT.LTD Full time

    **Company Description** Strydo Technologies is an industrial skill provider for IT professionals located in Tirupati. The company offers IT training, Research & Development, Internship, Web development, and Faculty Development programs. This is a great opportunity for individuals looking to enhance their skills and knowledge in the IT industry. **Role...

  • VDC Engineer

    3 weeks ago

    tirupati, India Modelyze Labs AI Full time

    Modelyze Labs AI is using Artificial Intelligence to build and label three dimensional models to make their analysis clear, concise, and accurate.The RoleModelyze Labs has an immediate need for a Virtual Design and Construction (VDC) professional with an Architectural background, expertise in detailing software (Revit and AutoCAD), Navisworks model...

  • Staff Backend Engineer

    2 months ago

    Tirupati, India ThoughtSpot Full time

    About the role:Come join a team of world-class engineers building ThoughtSpot’s relational search engine. We are looking for engineers with a proven track record of being industry visionaries to join the team responsible for building ThoughtSpot’s natural language relational search engine, personalised data exploration engine, universal object search...

  • Telematics Engineer

    3 weeks ago

    tirupati, India Boson Motors Full time

    About Boson Motors:Boson Motors is a Californiabased startup revolutionizing the electric vehicle industry. Ourmission is to drive innovation in eautomotive solutions for farm automation empowering theagriculture industry with cuttingedge technology. As pioneers in the Battery Energy StorageSystem (BESS) product segment we are committed to creating...

  • Telematics Engineer

    1 week ago

    tirupati, India Boson Motors Full time

    About Boson Motors:Boson Motors is a Californiabased startup revolutionizing the electric vehicle industry. Ourmission is to drive innovation in eautomotive solutions for farm automation empowering theagriculture industry with cuttingedge technology. As pioneers in the Battery Energy StorageSystem (BESS) product segment we are committed to creating...

  • Telematics Engineer

    2 months ago

    Tirupati, India Boson Motors Full time

    Job...

  • Telematics Engineer

    1 month ago

    Tirupati, India Boson Motors Full time

    About Boson Motors: Boson Motors is a Californiabased startup revolutionizing the electric vehicle industry. Our mission is to drive innovation in eautomotive solutions for farm automation empowering the agriculture industry with cuttingedge technology. As pioneers in the Battery Energy Storage System (BESS) product segment we are committed to creating...

  • Software Engineer

    4 weeks ago

    Tirupati, India ELife Full time

    Our Company:A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global.Vision: Reliable ground transportation services globally with all types of vehicles.​Mission: Empower high quality local fleets​Coorporate Culture: team firstPartner-centric​Team...

  • Telematics Engineer

    2 months ago

    Tirupati, India Boson Motors Full time

    About Boson Motors: Boson Motors is a California-based startup revolutionizing the electric vehicle industry. Our mission is to drive innovation in e-automotive solutions for farm automation, empowering the agriculture industry with cutting-edge technology. As pioneers in the Battery Energy Storage System (BESS) prod...

  • Advanced Lead Engineer – GEnx CDN LCE

    2 months ago

    tirupati, India GE Full time

    Job Description Summary About us: At GE Aviation, we are imagination at work. Whether we're supporting the fielded engines to ensure peoples safety or driving innovations in fuel, noise and weight/cost reductions in our NPIs, the GE Aviation teams are dedicated to turning imaginative ideas into advances in aviation that solve some of the world's toughest...

  • DevSecOps Engineer

    2 months ago

    tirupati, India OLX India Full time

    Devsecops Engineer Gurugram, Haryana – Engineering /Full-Time We at OLX work together to build a more sustainable world through trade. We make it safe, smart, and convenient to buy and sell cars, find housing, get jobs, buy and sell household goods, and more. We are looking for a Devsecops Engineer to empower millions of people across the globe by helping...

  • Telematics Engineer

    2 months ago

    Tirupati, India Boson Motors Full time

    AboutBoson Motors:BosonMotors is a Californiabased startup revolutionizing the electricvehicle industry. Ourmissionis to drive innovation in eautomotive solutions for farm automationempowering theagricultureindustry with cuttingedge technology. As pioneers in the BatteryEnergy StorageSystem(BESS) product segment we are committed to creating...

  • Search Engine Optimization

    4 months ago

    tirupati, India Puretech Digital Full time

    Job Overview: We are seeking a highly skilled and dedicated SEO Specialist to join our dynamic team. The ideal candidate will be responsible for various aspects of search engine optimization, including keyword research, website evaluation, on-site optimization, content recommendations, link acquisition, and monthly reporting. The role requires a meticulous...

  • Python AI Lead Senior Engineer

    2 weeks ago

    Tirupati, India Open English Full time

    The Open English brand has been a leader in online English language learning for 16 years. We are proud to be a global education technology (EdTech) leader offering online language learning to adults and children through its Open English Junior brand, as well as various online certificates in digital, technology, and business specializations. We are...