Data Engineer 2

3 weeks ago

Bengaluru, Karnataka, India Epsilon Full time

Job Title: Data Engineer 2

Job Summary:

Epsilon is seeking a highly skilled Data Engineer 2 to join our Engineering team. As a Data Engineer 2, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines to support our personalization efforts.

Key Responsibilities:

  • Develop solutions for Epsilon that will deliver high-quality personalized recommendations across different channels to our customers
  • Work with the Data Science team to ensure seamless integration and support of machine learning models
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies
  • Develop end-to-end (Data/Dev/MLOps) pipelines based on in-depth understanding of cloud platforms, AI/ML lifecycle, and business problems to ensure solutions are delivered efficiently and sustainably
  • Collaborate with other members of the team to ensure high-quality deliverables
  • Learn and implement the latest design patterns in software engineering

Requirements:

  • Bachelor's Degree in Engineering and related field with 2+ years of similar experience
  • Tech Stack: Python, PySpark, Micro services, Docker, Serverless Frameworks & Databricks
  • Hands-on experience building ETL workflows/pipelines
  • Experience in relational and non-relational databases and SQL (NoSQL is a plus)
  • Experience with Cloud technologies (AWS or Azure)
  • Experience building Data and CI/CD/MLOps pipelines
  • Familiarity with Airflow and MLFlow tools
  • Familiarity with automated unit/integration test frameworks
  • Experience working on AdTech or MarTech technologies is added advantage
  • Knowledge of machine learning algorithms and concepts and implementation will be a plus
  • Good written and spoken communication skills, team player
  • Strong analytic thought process and ability to interpret findings

Data Management:

  • Experience with both structured and unstructured data, and Hadoop, Apache Spark, or similar technologies
  • Good understanding of Data Modeling, Data Warehouse, Data Catalog concepts and tools
  • Experience with Data Lake architectures, and with combining structured and unstructured data into unified representations
  • Able to identify, join, explore, and examine data from multiple disparate sources and formats
  • Ability to reduce large quantities of unstructured or formless data and get it into a form in which it can be analyzed
  • Ability to deal with data imperfections such as missing values, outliers, inconsistent formatting, etc.
  • Ability to manipulate large datasets, (millions of rows, thousands of variables)

Software Development:

  • Ability to write code in programming languages such as Python, PySpark and shell script on Linux
  • Familiarity with software development methodology such as Agile/Scrum
  • Love to learn new technologies, keep abreast of the latest technologies within the cloud architecture, and drive your organization to adapt to emerging best practices

Architecture and Infrastructure:

  • Architectural design experience on AWS
  • Experience in delivering software with AWS EC2, S3, EMR/Glue, Lambda, Data Pipeline, CloudFormation, Redshift etc.
  • Good knowledge of working in UNIX/LINUX systems

In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.

  • Data Engineer 2

    2 weeks ago

    Bengaluru, Karnataka, India Epsilon Full time

    Job Title: Data Engineer 2Job Summary:Epsilon is seeking a highly skilled Data Engineer 2 to join our Engineering team. As a Data Engineer 2, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines to support our personalization efforts.Key Responsibilities:Develop solutions for Epsilon that will deliver...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Visualization Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: PowerBI Data Visualisation EngineerAbout the Role:We are seeking a skilled PowerBI Data Visualisation Engineer to join our team at NTT DATA Services. As a key member of our data analytics team, you will be responsible for designing, developing, and maintaining interactive dashboards and reports using PowerBI.Key Responsibilities:Collaborate with...

  • Data Visualization Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: PowerBI Data Visualisation EngineerList of Key Responsibilities:Design, develop, and maintain interactive dashboards and reports using PowerBI.Collaborate with data analysts, data engineers, designers and business stakeholders to gather requirements and ensure accurate, timely, and effective delivery of data visualisations.Transform raw data into...

  • Data Engineer 2

    4 days ago

    Bengaluru, Karnataka, India Epsilon Full time

    About the RoleEpsilon is seeking a highly skilled Data Engineer to join our Engineering team. As a key member of our team, you will be responsible for building solutions that deliver high-quality personalized recommendations across various channels to our customers.Key ResponsibilitiesDevelop solutions for Epsilon that will deliver high-quality personalized...

  • Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Data Engineer 2

    3 weeks ago

    Bengaluru, Karnataka, India Epsilon Full time

    Job Title: Data Engineer 2Job Summary:Epsilon is seeking a highly skilled Data Engineer 2 to join our Engineering team. As a Data Engineer 2, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines. You will work closely with cross-functional teams to ensure seamless integration and support of machine learning...

  • Data Engineer Lead

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Data Engineer 2

    3 weeks ago

    Bengaluru, Karnataka, India Epsilon Full time

    Job DescriptionOrganization Objective/Purpose:Epsilon is seeking a highly skilled Data Engineer to join our Engineering team. As a key member of our team, you will play a critical role in driving the first mile of the customer experience through personalization of offers and content.You will be part of a team that is focused on building solutions, pipelines...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT DATA. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines using Azure data factory and Azure databricks.Key Responsibilities:Design and develop innovative data pipelines using Azure...

  • Data Engineer 2 Position

    1 week ago

    Bengaluru, Karnataka, India JLL Full time

    JLL empowers you to shape a brighter way. Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world-class services, advisory, and technology for our clients. We are committed to hiring the best, most talented people and empowering them to thrive, grow meaningful careers, and find a place where they...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Data SpecialistWe are seeking a highly skilled Data Specialist to join our team in Bangalore, India. As a Data Specialist, you will be responsible for designing and developing data pipelines utilizing cloud technologies such as Azure, AWS, and GCP.Key Responsibilities:Design and develop data pipelines using cloud technologiesLead a team of data...

  • Data Engineer 2

    3 days ago

    Bengaluru, Karnataka, India Epsilon Full time

    Job Description Organization Objective/Purpose : Epsilon is seeking a highly skilled Data Engineer 2 to join our Engineering team. As a Data Engineer 2, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines. Your primary goal will be to ensure seamless data delivery to our customers through personalized...

  • Data Engineer 2 Position

    3 weeks ago

    Bengaluru, Karnataka, India JLL Full time

    Empowering a Brighter Future with Data Engineering ExpertiseJLL is committed to shaping the future of real estate through innovative data engineering solutions. As a Data Engineer 2, you will play a crucial role in developing and maintaining scalable and efficient data pipelines and workflows to ingest, transform, cleanse, and integrate large volumes of...

  • Data Engineer 2

    3 weeks ago

    Bengaluru, Karnataka, India Microsoft Full time

    OverviewMicrosoft is seeking a highly skilled Data Engineer to join our Office Platform team, where you will play a key role in building our M365 developer program. As a Data Engineer, you will be part of a dynamic and diverse team that works on cutting-edge technologies and delivers innovative solutions that empower millions of developers...

  • Data Engineer 2

    3 weeks ago

    Bengaluru, Karnataka, India Microsoft Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Office Platform team at Microsoft. As a Data Engineer, you will play a critical role in building our M365 developer program, working on cutting-edge technologies and delivering innovative solutions that empower millions of developers worldwide.Key ResponsibilitiesCollaborate with...

  • Data Engineer 2 Position

    2 weeks ago

    Bengaluru, Karnataka, India JLL Full time

    JLL Empowers Data-Driven InnovationAt JLL, we're shaping the future of real estate by combining world-class services, advisory, and technology for our clients. As a Data Engineer 2, you'll play a crucial role in developing and maintaining scalable data pipelines and workflows to ingest, transform, cleanse, and integrate large volumes of structured and...

  • Data Engineer 2

    2 weeks ago

    Bengaluru, Karnataka, India Microsoft Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Office Platform team at Microsoft. As a Data Engineer, you will play a key role in building our M365 developer program, working on cutting-edge technologies and delivering innovative solutions that empower millions of developers worldwide.ResponsibilitiesCollaborate with stakeholders to...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...