Current jobs related to ParallelDots - Lead Data Engineer - Spark/Python - Gurugram - Paralleldots
-
ParallelDots - Lead Data Engineer - Spark/Python
1 month ago
Gurgaon/Gurugram/Bangalore, India Paralleldots Full timeJob Description : As a Lead Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : 1. Lead the design,...
-
Data Engineer
3 months ago
Gurugram, India Uncap Research Labs Full timeJob Description :Apache Spark : - Expertise in Spark for large-scale data processing and analytics, including Spark SQL and Spark Streaming.Apache Kafka : - Proficiency in Kafka for real-time data streaming, message brokering, and building event-driven architectures.Apache Cassandra : - In-depth knowledge of Cassandra for scalable and high-performance...
-
Lead Data Engineer
2 weeks ago
gurugram, India Atyeti Inc Full timeJob Description:Experience in building and optimizing Data Engineering pipeline, architectures and data setsExtensive working experience with backend programing languages like SQL & Python is a mustExperience with big data systems such as Hadoop, Spark, PySpark, Databricks etc. is desiredHave good exposure of both relational & non-relational database...
-
Data Engineer
4 weeks ago
Gurgaon/Gurugram, IN Uncap Research Labs Full timeJob Description :Apache Spark : - Expertise in Spark for large-scale data processing and analytics, including Spark SQL and Spark Streaming.Apache Kafka : - Proficiency in Kafka for real-time data streaming, message brokering, and building event-driven architectures.Apache Cassandra : - In-depth knowledge of Cassandra for scalable and high-performance...
-
Data Engineer
3 weeks ago
Gurgaon/Gurugram, India Uncap Research Labs Full timeJob Description : Apache Spark : - Expertise in Spark for large-scale data processing and analytics, including Spark SQL and Spark Streaming. Apache Kafka : - Proficiency in Kafka for real-time data streaming, message brokering, and building event-driven architectures. Apache Cassandra : - In-depth knowledge of Cassandra for scalable and...
-
Lead Data Engineer
2 weeks ago
Gurugram, India Atyeti Inc Full timeJob Description:Experience in building and optimizing Data Engineering pipeline, architectures and data setsExtensive working experience with backend programing languages like SQL & Python is a mustExperience with big data systems such as Hadoop, Spark, PySpark, Databricks etc. is desiredHave good exposure of both relational & non-relational database...
-
Lead Data Engineer
2 weeks ago
gurugram, India Atyeti Inc Full timeJob Description:Experience in building and optimizing Data Engineering pipeline, architectures and data setsExtensive working experience with backend programing languages like SQL & Python is a mustExperience with big data systems such as Hadoop, Spark, PySpark, Databricks etc. is desiredHave good exposure of both relational & non-relational database...
-
Lead Data Engineer
2 weeks ago
Gurugram, India Atyeti Inc Full timeJob Description:Experience in building and optimizing Data Engineering pipeline, architectures and data setsExtensive working experience with backend programing languages like SQL & Python is a mustExperience with big data systems such as Hadoop, Spark, PySpark, Databricks etc. is desiredHave good exposure of both relational & non-relational database...
-
Lead Data Engineer
2 weeks ago
Gurugram, India Atyeti Inc Full timeJob Description: Experience in building and optimizing Data Engineering pipeline, architectures and data sets Extensive working experience with backend programing languages like SQL & Python is a must Experience with big data systems such as Hadoop, Spark, PySpark, Databricks etc. is desired Have good exposure of both relational & non-relational database...
-
Azure Data Engineer
3 weeks ago
Gurugram, India Element Infomatics (India) Pvt. Ltd. Full timeAbout the job :Company Description:Element Technologies Inc is a technology company based in Bangalore, committed to offering high-value IT services using flexible engagement and delivery models. We collaborate with global industry-leading technologies to deliver greater business value in sectors such as Life Sciences, Banking & Financial Services, Retail,...
-
Senior Lead Data Engineer
5 months ago
Gurgaon/Gurugram, India HuQuo Full timeJob Description :Must-Have :- 10+ years of experience in software development and delivery.- 5 to 7 years of relevant work experience on large-scale Data applications- Good aptitude, strong problem-solving abilities, and analytical skills- Should have team handling experience , leading team of 6-7 members OR handle 2-3 smaller teams- Should be able to do...
-
Databricks Engineer
4 months ago
Gurgaon/Gurugram, India Www.Huquo.com Full timeJob Description : The Databricks/Spark Developer would need to have at least 3+ years of experience. As the Databricks/Spark Developer, you will build end to end business solutions and work with one of the leading supply chain solutions providers in the US. The ideal candidate must possess excellent background on Hadoop technologies. The candidate must...
-
AWS Data Engineer
3 days ago
Bangalore/Delhi/Gurgaon/Gurugram/Noida, IN Prodigy hunters Full timeJob Description :We are seeking a skilled AWS Data Engineer with expertise in Airflow, Python, ETL, Spark, SQL databases, and AWS Cloud to join our team. The role involves designing and implementing robust data pipelines, managing ETL workflows, and optimizing data solutions in a hybrid cloud environment.Roles and Responsibilities :- Data Pipeline...
-
Lead Big Data Engineer
3 months ago
Gurugram, India Huntingcube Recruitment Solutions Full timeJob Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability.- Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data storage...
-
Azure Data Engineer
3 weeks ago
Gurgaon/Gurugram/Bangalore/Chennai/Pune/Mumbai, IN Element Infomatics Pvt. Ltd. Full timeAbout the job :Company Description:Element Technologies Inc is a technology company based in Bangalore, committed to offering high-value IT services using flexible engagement and delivery models. We collaborate with global industry-leading technologies to deliver greater business value in sectors such as Life Sciences, Banking & Financial Services, Retail,...
-
Lead Big Data Engineer
4 weeks ago
Gurgaon/Gurugram, IN Huntingcube Recruitment Solutions Full timeJob Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability.- Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data storage...
-
Lead Big Data Engineer
3 weeks ago
Gurgaon/Gurugram, India Huntingcube Recruitment Solutions Full timeJob Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability. - Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data...
-
Big Data Engineer
3 months ago
Gurugram, India ACS Consultants Full timePosition Overview :As a Big Data Engineer, you will be responsible for designing, developing, and managing large-scale data processing systems using Hadoop, Hive, and Spark. You will work closely with data scientists, analysts, and other stakeholders to ensure the efficient and effective processing of big data to drive key business decisions.Key...
-
Data Engineer with Spark Expertise
5 days ago
Pune/Gurgaon/Gurugram, India Huquo Full timeJob SummaryAt Huquo, we are seeking a highly skilled Data Engineer with Spark Expertise to join our team. As a key member of our engineering team, you will be responsible for building and maintaining large-scale data pipelines using Spark technologies. Your expertise in data engineering, agile methodology, and team leadership will be invaluable in driving...
-
Lead Data Engineer – Big Data
4 weeks ago
Gurugram, India Incedo Inc. Full timeRole Description: Sr. Lead Data Engineer – Big DataThe ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous...
ParallelDots - Lead Data Engineer - Spark/Python
3 months ago
Job Description :
As a Lead Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :
1. Lead the design, implementation, and maintenance of complex data pipelines and architectures.
2. Mentor junior data engineers and oversee their contributions to projects.
3. Collaborate with data scientists and analysts to optimize data models and queries for performance.
4. Develop and implement data governance and security protocols.
5. Evaluate new technologies and tools to extend or improve our data platforms.
6. Work closely with the CTO and other senior leaders to align data engineering projects with business objectives.
7. Expertise with at least one hyper scalers - AWS or GCP
Qualifications :
1. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
2. Minimum of 3-6 years of experience in data engineering.
3. Expertise in big data technologies like Spark, and Kafka.
4. Strong programming skills in Python
5. Proven experience in designing and implementing real-time data solutions.
6. Excellent leadership and communication skills.