Big Data Engineer
1 week ago
Responsibilities :
- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.
- Perform data analysis, transformation, and cleansing to extract valuable insights.
- Optimize performance and scalability of big data applications.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
- Stay up-to-date with the latest advancements in big data technologies and trends.
- Troubleshoot and resolve complex data-related issues.
Qualifications :
- 5+ years of experience in big data engineering and development.
- Strong proficiency in Hadoop, PySpark, and related technologies.
- In-depth understanding of big data concepts, including data ingestion, processing, and analysis.
- Experience with data warehousing and data lakes.
- Knowledge of SQL and NoSQL databases.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills
-
Big Data Engineer
1 week ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timePosition : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...
-
Lead Big Data Engineer
4 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeAbout the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...
-
Cloud Big Data Engineer
1 week ago
Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full timeAbout the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...
-
NucleusTeq - Big Data Engineer - Spark/Scala
2 weeks ago
Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full timeRole : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...
-
Anywhere in India/Multiple Locations AEONOVATECH PRIVATE LIMITED Full timeKey Responsibilities :- Lead and mentor a team of Big Data Engineers.- Participate in the design and implementation of the big data analytics architecture on Azure.- Develop and implement big data pipelines using Spark Scala and Python.- Write complex Hive queries to extract valuable insights from data lakes.- Collaborate with cross-functional teams (QA,...
-
Big Data Solutions Lead
4 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeJob DescriptionWe are looking for a highly experienced Big Data Solutions Lead to join our team at AJ Consulting. In this role, you will be responsible for designing and implementing scalable and robust data pipelines using PySpark.You will also ensure data accuracy and integrity by implementing data validation and quality checks, and mentor and coach team...
-
Cloud Big Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full timeAbout the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...
-
Engineering Lead
1 week ago
Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full timeWe are seeking an experienced Engineering Lead - Data Processing to lead our efforts in building and maintaining cutting-edge big data processing systems. As a key member of our engineering team, you will be responsible for overseeing the design, implementation, and maintenance of our big data infrastructure, ensuring seamless integration with existing...
-
Big Data Developer
2 weeks ago
Anywhere in India/Multiple Locations Populace World Solution Full timeJob Description : - Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. - Proficient in using Spark/Scala - Experience with data Import/Export using Sqoop or similar tools - Experience using Airflow, Jenkins or similar other automation tools - Excellent knowledge of SQL Server and database...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Patch Infotech Private Limited Full timeKey Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...
-
Senior Big Data Engineer
1 week ago
Remote/Anywhere in India/Multiple Locations DXC Luxoft Full timeProject Description : We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products. Responsibilities : - Choosing the right technologies for our use cases, deploy and operate. - Setting up...
-
Senior Big Data Engineer
5 days ago
Anywhere in India/Multiple Locations CYMETRIX INFOTECH PRIVATE LIMITED Full time**Overview:**CYMETRIX INFOTECH PRIVATE LIMITED is a cutting-edge technology company that provides innovative solutions for businesses. We are committed to helping organizations make data-driven decisions.**Job Title:**AWS Data Architect**About the Role:**We are seeking a seasoned AWS Data Architect to lead our data engineering team and develop scalable data...
-
Big Data Engineer
4 days ago
Remote/Anywhere in India/Multiple Locations Upraised Full timeAt Upraised, we are seeking a highly skilled Data Warehouse Architect to lead the design and development of our robust data infrastructure.This critical role is responsible for creating efficient data models and schema designs that support business intelligence and analytics needs. The ideal candidate will have hands-on experience in building, optimizing,...
-
Big Data Architect
5 days ago
Anywhere in India/Multiple Locations Insight Global Full timeJob DetailsWe are seeking an experienced Data Engineer to join our team at Insight Global. This is a 100% remote position, allowing for flexibility and work-life balance. The ideal candidate will have strong proficiency in Python and SQL, as well as experience with data visualization tools such as Tableau or Looker.Responsibilities:Build, maintain, and scale...
-
Big Data Solutions Expert
1 week ago
Anywhere in India/Multiple Locations Sureminds Full time**Required Skills and Qualifications**To be successful in this role, you will need to possess the following skills and qualifications:Bachelor's degree in Engineering, Computer Science, Data Science, or related field3+ years of experience in software development, data science, data engineering, ETL, and analytics reporting developmentExperience designing,...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Sureminds Full timeAs a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...
-
Big Data and Analytics Lead
2 days ago
Anywhere in India/Multiple Locations Cybyrotek Solutions Full timeJob Title: Senior Data EngineerAbout Cybyrotek Solutions: We are a leading technology company that provides innovative data engineering solutions to its clients.The Job: We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining large-scale data pipelines and...
-
Cloud Data Engineer
1 week ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeKey RequirementsTo be considered for this position, you must have:Minimum of 8 years of industry experience working with Big Data technologies.Proficiency in Hadoop, Hive, and PySpark for data processing.Strong experience with Unix Shell Scripting.Expertise in SQL and extracting data from multiple sources.Demonstrated experience in data analysis,...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations RECRUTMENT Full timeRequired Skills and Qualifications :- Proficiency in Apache Spark for batch and streaming data processing.- Strong knowledge of orchestration tools like Apache Airflow.- Experience with big data frameworks and technologies (e.g., Hadoop, Kafka).- Familiarity with AWS data services such as Glue, Athena, and Kinesis.- Understanding of event-driven...