Data Engineer 2
2 months ago
Organization Objective/Purpose :
This position in the Engineering team under the Digital Integration Services organization. We drive the first mile of the customer experience through personalization of offers and content. We are currently on the lookout for a smart, highly driven software engineer.
You will be part of a team that is focused on building solutions, pipelines using latest software engineering design principles and tech stacks. You will also be expected to Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery and automate continuous integration and deployment processes/pipelines.
The incumbent is also expected to partner with various stakeholders, bring scientific rigor to design and develop high quality software.
She / He also must have excellent verbal and written communication skills and be comfortable working in an entrepreneurial, ‘startup’ environment within a larger company.
Brief Description of Role :
- Develop solutions for Epsilon that will deliver high quality personalized recommendations across different channels to our customers
- Working with Data science team to ensure seamless integration and support of machine learning models.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Develop end-to-end (Data/Dev/MLOps) pipelines based on in-depth understanding of cloud platforms, AI/ML lifecycle, and business problems to ensure solutions are delivered efficiently and sustainably.
- Collaborate with other members of the team to ensure high quality deliverables
- Learning and implementing the latest design patterns in software engineering
Qualifications
- Bachelor’s Degree in Engineering and related field with 2+ years of similar experience
- Tech Stack: Python, PySpark, Micro services, Docker, Serverless Frameworks & Databricks.
- Hands on experience building ETL workflows/pipelines
- Experience in relational and non-relational databases and SQL (NoSQL is a plus).
- Experience with Cloud technologies (AWS or Azure)
- Experience building Data and CI/CD/MLOps pipelines
- Familiarity with Airflow and MLFlow tools
- Familiarity with automated unit/integration test frameworks
- Experience working on AdTech or MarTech technologies is added advantage
- Knowledge of machine learning algorithms and concepts and implementation will be a plus
- Good written and spoken communication skills, team player.
- Strong analytic thought process and ability to interpret findings
Data Management
- Experience with both structured and unstructured data, and Hadoop, Apache Spark, or similar technologies
- Good understanding of Data Modeling, Data Warehouse, Data Catalog concepts and tools
- Experience with Data Lake architectures, and with combining structured and unstructured data into unified representations
- Able to identify, join, explore, and examine data from multiple disparate sources and formats
- Ability to reduce large quantities of unstructured or formless data and get it into a form in which it can be analyzed
- Ability to deal with data imperfections such as missing values, outliers, inconsistent formatting, etc.
- Ability to manipulate large datasets, (millions of rows, thousands of variables)
Software Development
- Ability to write code in programming languages such as Python, PySpark and shell script on Linux
- Familiarity with software development methodology such as Agile/Scrum
- Love to learn new technologies, keep abreast of the latest technologies within the cloud architecture, and drive your organization to adapt to emerging best practices
Architecture and Infrastructure
- Architectural design experience on AWS.
- Experience in delivering software with AWS EC2, S3, EMR/Glue, Lambda, Data Pipeline, CloudFormation, Redshift etc.
- Good knowledge of working in UNIX/LINUX systems
In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.
Additional Information
Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.
Conditions of Employment
All job offers are contingent upon successful completion of background checks.
Great People, Deserve Great Benefits
We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career. We offer associates a variety of benefits that work as hard for them as they work for us.
We have other current jobs related to this field that you can find below
-
Data Engineer 2
2 months ago
bangalore, India JLL Full timeData Engineer 2 JLL Technologies COE About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build...
-
Senior Mechanical Engineer
3 weeks ago
bangalore, India Abha Engineer Full timeWe are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.
-
Senior Mechanical Engineer
2 months ago
bangalore, India Abha Engineer Full timeWe are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.
-
Data Engineer 2
2 months ago
bangalore, India Amadeus Full timeJob Title Data Engineer 2Key responsibilities •Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets. •Ensure the reliability, scalability, and performance of our data assets. •Design and maintain quality indicators as well as the corresponding monitoring and alerting means. ...
-
Data Engineer 2
3 weeks ago
bangalore, India Amadeus Full timeJob Title Data Engineer 2Key responsibilities •Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets. •Ensure the reliability, scalability, and performance of our data assets. •Design and maintain quality indicators as well as the corresponding monitoring and alerting means. ...
-
Data Engineer 2
3 weeks ago
bangalore, India Microsoft Full timeOverview Data Engineer - Office Platform Microsoft IDC - Bengaluru, India Profession: Software Engineering Discipline: Data Engineering Microsoft is a global leader in software, services, devices and solutions that empower every person and every organization on the planet to achieve more. Our mission is to enable people and businesses...
-
Data Engineer 2
1 month ago
bangalore, India Microsoft Full timeOverview Data Engineer - Office Platform Microsoft IDC - Bengaluru, India Profession: Software Engineering Discipline: Data Engineering Microsoft is a global leader in software, services, devices and solutions that empower every person and every organization on the planet to achieve more. Our mission is to enable people and businesses...
-
Senior Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...
-
Data Engineer 2
2 months ago
bangalore, India BigShyft Full timeRoleOverview: As a Data Engineer 2you will be responsible for designing implementing and maintainingscalable data pipelines and systems. You will collaborate closelywith crossfunctional teams to understand data requirements developrobust solutions and ensure the reliability and performance of ourdata infrastructure. This role offers an exciting opportunity...
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Data Engineer
1 month ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Data Engineer
4 weeks ago
bangalore, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...
-
Sr data engineer
1 day ago
bangalore, India NTT DATA Services Full timeReq ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer ...
-
Bangalore, India NTT DATA Services Full timeAzure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...
-
Data Engineer
1 month ago
bangalore, India NTT DATA Services Full timeData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...
-
Data Engineer
4 weeks ago
Bangalore, India NTT DATA Services Full timeData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...
-
Data Engineer-2
1 month ago
bangalore, India E901 DWS India Private Limited, Bangalore Branch Full timeDescription Role is an Data Engineer to manage the databases/data warehouses/ data marts within the Asset Management Fund Accounting/Investment Business. Has good understanding of Bafin/FCA/BundesBank regulatory reporting framework and reporting experiences. Can handle the day-to-day BAU of several Datawarehouse and Database Applications as part...
-
Data Analyst 2
3 weeks ago
bangalore, India Oracle Full timeBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team will focus on product development and product strategy for Oracle Health, while building out a complete platform supporting modernized, automated healthcare. This is a net new line of business, constructed with an entrepreneurial...
-
Data Analyst 2
2 months ago
bangalore, India Oracle Full timeBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team will focus on product development and product strategy for Oracle Health, while building out a complete platform supporting modernized, automated healthcare. This is a net new line of business, constructed with an entrepreneurial...
