Data Engineer for Large-Scale Data Systems
2 weeks ago
Job Description:
We are seeking an experienced Data Engineer to join our team at Advent Global Solution Private Limited.
The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data systems using Python, Scala, SQL, and Unix scripting.
Key Responsibilities:
- Develop and maintain architectures such as databases and large-scale processing systems.
- Utilize Big Data technologies including Hadoop, Hive, Hbase, and Spark to manage and manipulate large data sets.
- Write and optimize SQL and HQL for database management and data manipulation.
- Implement coding best practices to maintain software quality and readability.
- Optimize queries and tune performance for Hive and Spark applications.
Requirements:
- A minimum of 5-7 years of industry experience in data engineering.
- Strong programming skills with at least 5 years of experience in Python, Scala, and SQL.
- Expertise in Big Data technologies such as Hadoop, Hive, Hbase, and Spark.
- Proficiency in Unix scripting with a minimum of 5 years of experience.
- Deep knowledge of SQL and HQL.
- Solid understanding of coding best practices.
- Experience in query optimization and performance tuning, particularly for Hive and Spark.
Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.
-
Data Engineering Expert
9 hours ago
Pune, Maharashtra, India PRI Global Full timeAt PRI Global, we are seeking a seasoned Data Engineer to lead our efforts in designing and optimizing large-scale data systems. With a strong focus on innovation and collaboration, this role offers the perfect blend of technical challenge and professional growth.Job Title: Senior Data EngineerLocation: Pune, IndiaOverview:We require a highly skilled Data...
-
Pune, Maharashtra, India Evnek Technologies Full timeEvnek Technologies is seeking an experienced Data Engineer with a strong background in SQL and PySpark to design, develop, and maintain large scale data infrastructure.Job OverviewThe ideal candidate will have at least 5 years of experience working with Azure cloud services and be proficient in writing complex SQL queries and optimizing performance. They...
-
Large Scale Distributed Systems Developer
2 weeks ago
Pune, Maharashtra, India Sibros Full timeAccelerating the Future of SDV ExcellenceSibros' Deep Connected Platform empowers the automotive industry by providing seamless software update management, vehicle analytics, and remote commands in a single platform.Job DescriptionWe are seeking a highly skilled Software Engineer II to join our team in Pune, India. This role involves tackling challenging...
-
Pune, Maharashtra, India Lear Corporation Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Lear Corporation. This role will be responsible for designing, building, and maintaining large-scale data pipelines within Palantir Foundry.About the RoleIn this position, you will collaborate with cross-functional teams to ensure data solutions are robust, reliable, and...
-
Data Processing Systems Engineer
2 weeks ago
Pune, Maharashtra, India Advent Global Solution Private Limited Full timeJob DescriptionWe are seeking a highly skilled Data Processing Systems Engineer to join our team at Advent Global Solution Private Limited. The ideal candidate will have a strong background in data engineering, with expertise in designing, developing, and maintaining large-scale data processing systems.The successful candidate will have experience in...
-
Data Systems Engineer
2 months ago
Pune, Maharashtra, India Rohini IT Consulting LLP Full timeRohini IT Consulting LLP seeks a highly skilled Data Systems Engineer to design, implement, and maintain large-scale data processing systems.Key Responsibilities:- Design and develop scalable data pipelines using Star/Snowflake schema design and data modeling.- Collaborate with cross-functional teams to implement data warehouse technologies (e.g., Snowflake,...
-
Pune, Maharashtra, India IntraEdge Full timeAbout IntraEdge">IntraEdge is a Technology, Products and Learning Organization founded in 2002 with offices across the globe.We provide our clients with resources and expertise to enhance business performance through technology.">Job Description">As a Senior Python Engineer at IntraEdge, you will leverage cutting-edge technologies to drive business insights....
-
Pune, Maharashtra, India IntraEdge Full timeAbout the RoleWe are seeking a highly skilled Senior Python Engineer to join our team at Intraedge. As a key member of our technical team, you will be responsible for designing and implementing large-scale systems that meet the needs of our clients.Key ResponsibilitiesDesign and develop scalable and efficient software solutions using Python and related...
-
DevOps Expert for Large-Scale IT Systems
1 month ago
Pune, Maharashtra, India Luxoft Full timeAbout This RoleLuxoft is seeking an experienced Senior DevOps Engineer to join our team. As a key member of our organization, you will be responsible for ensuring the smooth operation of our large-scale IT systems.Our ideal candidate will have a minimum of 5 years of experience in DevOps technology tools and automation capabilities, with a proven track...
-
Azure Data Solutions Engineer
2 weeks ago
Pune, Maharashtra, India Ilink Systems Pvt Ltd Full timeAbout Ilink Systems Pvt Ltd:Ilink Systems Pvt Ltd is a technology-driven company that requires a highly skilled Azure Data Solutions Engineer to lead its cloud transformation and operations initiatives. The successful candidate will have a strong background in designing and implementing data lakes using Azure services.Job Description:The Azure Data Solutions...
-
Pune, Maharashtra, India Delphix Software Private Limited Full timeAbout the RoleDelphix Software Private Limited is seeking an experienced Enterprise Software Architect to join its Continuous Data team in India. This role requires strong experience in analyzing, debugging, and diagnosing complex software systems.Main Responsibilities:Architect, design, and implement large-scale components of the product to drive innovation...
-
Data Analytics Engineer
4 weeks ago
Pune, Maharashtra, India Data Dynamics Full timeAbout Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...
-
Senior Data Processing Engineer
4 days ago
Pune, Maharashtra, India Persistent Systems Full timePersistent Systems is seeking an experienced Data Processing Expert to join our team in developing a scalable data processing platform. This challenging role requires expertise in Python development and distributed database systems, as well as strong knowledge of MongoDB/Document DB and Elasticsearch implementation and optimization.The ideal candidate will...
-
Cloud Data Engineer
8 hours ago
Pune, Maharashtra, India Ubique Systems Full timeAt Ubique Systems, we're seeking an experienced Data Engineer to join our team. As a cloud-first organization, we're committed to harnessing the power of cutting-edge technologies to drive innovation and excellence.We're offering a highly competitive salary of $120,000-$180,000 per annum, depending on experience, to lead our data engineering efforts. If...
-
Senior Backend Engineer
3 weeks ago
Pune, Maharashtra, India JetSynthesys Full timeJob DescriptionWe are seeking an experienced Senior Backend Engineer to lead the development and maintenance of our large-scale multiplayer game's server-side logic. The ideal candidate will have a strong background in Python, Google App Engine (GAE), and deploy/build automation using Jenkins or similar tools.About the RoleArchitect and manage the underlying...
-
Python Software Engineer
4 weeks ago
Pune, Maharashtra, India IntraEdge Full timeAbout IntraEdgeIntraEdge is a Technology, Products and Learning Organization founded in 2002 with offices across the globe.What We OfferA competitive estimated salary of $140,000 - $160,000 per year for this role, depending on experience and qualifications.Job DescriptionWe are seeking a skilled Senior Python Engineer to join our dynamic team. This position...
-
Chief Data Engineer
2 weeks ago
Pune, Maharashtra, India Uddyam People Full timeJoin Our TeamWe are seeking an experienced Chief Data Engineer to join our team at Uddyam People. As a key member of our organization, you will be responsible for designing and implementing large-scale data architectures that meet the complex needs of our clients in the Finance sector. You will also lead the development of data engineering capabilities to...
-
Pune, Maharashtra, India Luxoft Full timeLuxoft, a leading provider of innovative software development services and solutions, is seeking a highly skilled Technical Architect to lead the development of large-scale enterprise software systems.As a key member of our team, you will be responsible for reengineering existing applications and introducing additional application interface layers to enable...
-
Data Science Expert for Machine Learning and NLP
1 month ago
Pune, Maharashtra, India Data Dynamics Full timeAbout Data DynamicsWe are a forward-thinking organization seeking a highly skilled Data Science Expert for Machine Learning and NLP to join our team. As a key member of our data science division, you will be responsible for developing and deploying innovative machine learning models to drive business growth.Estimated Salary: $140,000 - $180,000 per yearJob...
-
Pune, Maharashtra, India JetSynthesys Full timeJob Description: We are seeking a highly skilled Senior Backend Engineer to lead the development and maintenance of our server-side logic for a large-scale, globally serviced multiplayer Real-Time Strategy (RTS) game. As a key member of our engineering team, you will be responsible for architecting and managing the underlying infrastructure components...