Data Engineer
4 weeks ago
Id
- R&D00158
Title
- Data Engineer
Department
- Digital Transformation - R&D
BU
- Transformation & Innovation
Department
- R&D
Location
- Bangalore
Office Location
- Consero Bangalore
Due date
- 30/04/2024
Grade
- Senior Staff
Employment Type
- Full-time
Good To Have Skills
- Sigma, API Development, Web Development
Must Have Skills
- DBT, Snowflake, Azure OCR, FiveTran, Communication, ELT/ETL, Python
Experience Level
- 5 - 8 Years
External Description
We are seeking experienced, motivated and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients.
Role Description:
The data engineering role requires creating and managing technical solutions on the modern data stack (Snowflake, dbt, fivetran, Azure), architecting, building, and managing data flows/pipelines and construct data models within Snowflake to be used for other downstream processes or for analysis purposes.
Role Responsibility:
- Design, develop, and maintain scalable data pipelines and analytics solutions using DBT, Snowflake, and related technologies
- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions
- Develop efficient code with unit testing and code documentation
- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving
- Optimize and fine-tune data models, SQL queries, and transformations for performance and scalability
- Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake, ensure the effective transformation and load data from diverse sources into data warehouse or data lake.
- Integrate FiveTran connectors to streamline data ingestion from various sources into Snowflake
- Develop custom Python scripts and functions to automate data workflows and enhance system capabilities
- Provide technical expertise and support to resolve data-related issues and troubleshoot system failures
- Collaborate with the API development team to integrate data pipelines with external systems and applications
- Contribute to the development of web-based data visualization solutions and dashboards
- Communicate with all the project stakeholders on the project status
- Manage, monitor, and ensure the security and privacy of data to satisfy business needs
- Contribute to the automation of modules, wherever required
- Stay updated on emerging trends and technologies in data engineering, cloud computing, and analytics domains
External Skills And Expertis e
Role Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Proven experience of at least 5 years as a data engineer, ETL developer, or similar role, with a focus on DBT and Snowflake
- Strong proficiency in SQL and database concepts, with hands-on experience in Snowflake data warehou se
- Subject Matter expert of Data warehouse and Data Lake concepts (Dimensional Modelling, change data capture, slowly changing dimensions etc.)
- Proficiency in programming languages such as Python for data manipulation, automation, and scripting
- Knowledgeable in relational databases, nonrelational databases, data pipelines (ELT/ETL), and file stores
- Knowledgeable in performance tuning and optimization
- Experience with cloud platforms like Azure and tools like Azure OCR for data extraction and processing
- Familiarity with data integration tools like FiveTran
- Knowledge of API development principles and experience integrating data pipelines with external systems
- Proficient in written, verbal and presentation communication (Englis h)
- Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities
- Excellent analytical, problem-solving, and communication skills
-
Hevo Data
2 days ago
Bangalore/Bangalore, India HEVO DATA Full timeThis role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...
-
Data engineer
2 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Solution Engineer
4 weeks ago
Bangalore, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...
-
Data Engineer
2 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
3 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
3 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Tatras Data | Data Analyst
4 weeks ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple dataanalysts.Location: Bangalore/Hyderabad (Hybrid – 3 days in office)Experience Required: 3+ relevant years of experienceEducational Qualification: B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements:● Programming Expertise: Strong...
-
Tatras Data | Data Analyst
4 weeks ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple data analysts. Location: Bangalore/Hyderabad (Hybrid – 3 days in office) Experience Required: 3+ relevant years of experience Educational Qualification: B.Tech, B.Sc., or Software Engineering Key Skills and Requirements: ● Programming Expertise:...
-
Software Development Engineer II
4 weeks ago
Bangalore, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Hevo Data | Account Executive
2 weeks ago
bangalore, India Hevo Data Full timeHevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals including Deliverr, Neo4J, Groww, Marqeta, and Betway. By automating complex data integration tasks, Hevo...
-
bangalore, India Anicca Data Science Solutions Full timeJob descriptionAnicca Data is seeking a motivated Software Engineer who is eager to tackle complex challenges and apply their skills to innovative solutions. This role will primarily focus on developing code to manage large-scale data and working with intricate data structures. The successful candidate will contribute to existing codebases or create...
-
bangalore, India Hevo Data Full timeHevo is hiring for a passionate Sales Development Representative with an eagle-eye view who can identify the right prospects in need of our solution to make their life easy.Job Role :You should be on top of your account book and engage with prospects. Introduce and position Hevo as a one-stop solution for all their data integration and pipeline needs.Conduct...
-
Data Engineer
4 weeks ago
Bangalore, India Prydan Consultancy Full timeCompany Description : PRYDAN Consultancy Services is a global staffing solutions provider committed to excellence in recruitment services across various industries. With a focus on matching the right talent with the right opportunities, we empower clients and candidates to thrive in today's competitive landscape. Our comprehensive recruitment services...
-
Data engineer
2 weeks ago
Bangalore, India Capgemini Full timeLocation: PAN India Job Description (GCP Data Engineer): • Experience in GCP Data Engineering. • Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. • Should have worked on handling big data. • Strong communication skills. • experience in Agile methodologies ETL, ELT skills, Data...
-
Data engineer
2 weeks ago
Bangalore, India Collabera Digital Full timeRole: Data Engineer Proffered Client Location: Mumbai and Bengaluru(Onside) You will have the following responsibilities: Design Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced Analytics datasets based on your stakeholders’ requirements Design data pipelines to curate sourced data into the inhouse...
-
Data engineer
3 weeks ago
Bangalore, India Recro Full timeTitle: Data Engineer Key skills: Python + SQL + GCP / AWS + Kubernate+ CI/CD Good to have background in Oil & Gas Data Engineering team is part of Global Customer Success (GCS) organization, which has a global presence in Oslo (Norway), Austin & Houston (Texas, USA), Tokyo (Japan), and now Bengaluru, India. GCS comprises Project Managers, Data...
-
Data engineer
1 month ago
Bangalore, India Tech Mahindra Full timeis for GCP Data Engineer. If you're an experienced professional looking for an exciting new challenge. We want to hear from you! Please apply to with your resume explaining your experience and qualifications. Location : Pan India GCP Data Engineer : U2 – up to 3 years Primary Skill : Big Querry, Data flow, Data Composer, SQL,...
-
Data engineer
1 month ago
Bangalore, India NeuroGrid Full timeAbout the Company - At neuro Grid, we are revolutionizing renewable energy development with our purpose-built platform designed to simplify the complexities of developing renewable energy projects. By leveraging AI-powered automation and advanced data integration, we empower developers to make smarter decisions, streamline operations, and accelerate their...
-
Data engineer
3 weeks ago
Bangalore, India ValueLabs Full timeJOB DESCRIPTION: Experience: 5 to 7 years. IMMEDIATE to 20 days of joiners preferably. ● Design and implement scalable data pipelines for ingesting, transforming, and loading data from various tools and sources. ● Design data models to support data analysis and reporting. ● Collaborate with engineers, process managers, data scientists to...
