Current jobs related to Data Engineer - bangalore - VSquare Systems Pvt. Ltd.
-
Data engineer
2 weeks ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Data Engineer
2 weeks ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Solution Engineer
4 weeks ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Hevo Data
4 weeks ago
Bangalore, India HEVO DATA Full timeAbout Hevo Data : Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping...
-
Data Engineer
2 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
3 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
3 weeks ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Solutions Architect
5 days ago
Bangalore, India HEVO DATA Full timeOverview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...
-
Software Development Engineer II
4 weeks ago
Bangalore, Karnataka, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Solutions Engineer
1 month ago
bangalore, India Hevo Data Full timeOverview : We’re seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You’ll work one-on-one with the sales team to help discover our customers’ business and technical needs and demonstrate how Hevo’s platform can solve their real-time data replication needs. In this role, you will have a deep...
-
Senior Engineering Manager
2 weeks ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
5 months ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
2 weeks ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior engineering manager
1 week ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
1 month ago
bangalore, India Hevo Data Full timeAbout HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...
-
Senior Engineering Manager
1 month ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
2 months ago
Bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
6 days ago
bangalore, India Hevo Data Full timeAbout Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Senior Engineering Manager
4 weeks ago
Bangalore, India HEVO DATA Full timeAbout Hevo : At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...
-
Software Development Engineer II
2 weeks ago
Bangalore, India HEVO DATA Full timeAbout Hevo DataWe're a cutting-edge technology company that's revolutionizing the way businesses handle data. Our mission is to make data accessible and easy to use, so everyone can unlock its potential.Job DescriptionWe're looking for a highly skilled Software Development Engineer II to join our team. As a key member of our engineering team, you'll be...
Data Engineer
2 months ago
Job Description:
We are looking for a highly skilled Databricks PySpark Developer to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into data lake and data warehouse. You will work closely with data engineers, data scientists, and business intelligence teams to build and optimize data workflows that support the project's analytics and reporting needs.
Key Responsibilities:
1. ETL Development:
Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.
2. Data Pipeline Management:
Hands On experience in creating advanced data pipelines using databricks workflows
Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
Collaborate with data engineering, data science, and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.
3. Data Analysis and Query Optimization:
Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
4. Project Coordination and Continuous Improvement:
Participate in project planning and coordination activities to ensure timely delivery of ETL solutions.
Stay updated on the latest developments in Databricks PySpark, Spark SQL, and related technologies, recommending and implementing best practices and optimizations.
Document ETL processes, data lineage, and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.
Required Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field.
Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
Proven experience in working with large-scale data warehousing and ETL frameworks.
Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
Experience with cloud platforms with a preference for AWS.
Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
Demonstrated ability to implement best practices for ETL processes and data management.
Strong understanding of data governance and data quality principles.
Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.
