Truetech - Big Data Engineer - Apache Spark/Python
3 days ago
We have excellent Opportunity for Big Data Engineer.
Experience : 6-8 Years
Location : Chennai
Job Summary :
We are looking for an experienced Big Data Engineer to design, build, and optimize data pipelines using technologies like Apache Spark, Python, Apache Airflow, Kafka, and GCP (BigQuery, DataProc, Cloud Composer). You will work on scalable data solutions, real-time streaming, and ETL processes to support data-driven insights.
Key Responsibilities :
- Develop and optimize data pipelines using Apache Spark, Kafka, and Airflow.
- Implement real-time streaming solutions with Spark Streaming and Kafka.
- Work with GCP services such as BigQuery, DataProc, and Cloud Composer.
- Write efficient Python code for data processing and automation.
- Design and manage data workflows, ensuring reliability and scalability.
- Optimize SQL queries for data storage and retrieval.
Required Skills :
- 6-8 years experience in Big Data Engineering.
- Expertise in Apache Spark, Python, Kafka/Spark Streaming, and Airflow.
- Strong experience with GCP (BigQuery, DataProc, Cloud Composer).
- Proficiency in SQL and databases.
- Experience with real-time data processing and data pipeline orchestration.
Preferred :
- Cloud certifications (e.g., Google Cloud).
- Experience with Docker, Kubernetes, and Git.
(ref:hirist.tech)-
Big Data Engineer
3 days ago
Chennai, India Truetech Full timeScala Big data : 6-8 YearsLocation : ChennaiJob Summary :We are looking for an experienced Scala Big Data Engineer to develop and optimize data solutions. You will write ETL processes and Spark jobs using Scala or Java, work with GCP services, and implement real-time streaming with Kafka and Spark Streaming. Strong experience with SQL, Hadoop, and Apache...
-
Big Data Developer
6 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Big Data Engineer
2 months ago
Chennai, India Pan Asia Man power Consultants Recruiting agency Full timeJob Title : Big Data EngineerExperience Range : 6+ YearsLocation : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)Job Description :We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Gainwell Technologies Full timeData Engineer RoleWe are seeking a skilled Data Engineer to join our team at Gainwell Technologies. As a Data Engineer, you will be responsible for designing, developing, and deploying data pipelines using Apache Spark and AWS. Your expertise in big data technologies, such as Apache Spark, Kafka, and Hadoop, will be crucial in building large-scale data...
-
Big Data Engineer
2 months ago
Chennai/Pune, IN Pan Asia Man power Consultants Recruiting agency Full timeJob Title : Big Data EngineerExperience Range : 6+ YearsLocation : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)Job Description :We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with...
-
Chennai, Tamil Nadu, India Gainwell Technologies Full timeJob SummaryWe are seeking a highly experienced data engineer with Apache Spark and AWS expertise to join our data analytics team at Gainwell Technologies. As a key member of our cross-functional team, you will have the opportunity to design, develop, and deploy large-scale data pipelines, leveraging your technical skills to drive business growth and...
-
Big Data Developer
4 weeks ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Big Data Developer
2 months ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Big Data Engineer
3 months ago
Chennai, India a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Data Engineer - Big Data ArchitectureJob Summary:We are seeking a highly skilled Data Engineer to design, develop, and deploy scalable Big Data applications using Apache Spark.The successful candidate will collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.The Data Engineer...
-
Lead Data Engineer
1 month ago
Chennai, Tamil Nadu, India 1HResource Solutions Full timeLocation : Chennai. Shift : 11AM 8 PM or 1PM 10PM. Skills : Python, Big-Data, spark/pyspark, databricks, ADF or ADL, team management experience.Role Description :- As a Technical Lead Big Data Platform, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.- You will work with data...
-
Lead Data Engineer
1 month ago
Chennai, India 1HResource Solutions Full timeLocation : Chennai. Shift : 11AM 8 PM or 1PM 10PM. Skills : Python, Big-Data, spark/pyspark, databricks, ADF or ADL, team management experience.Role Description :- As a Technical Lead Big Data Platform, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.- You will work with data...
-
Big Data Engineer
2 months ago
Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full timeJob Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...
-
Senior Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeRiskInsight Consulting Pvt Ltd is seeking a Senior Big Data Engineer to join our team.Key Responsibilities:Design and Develop Big Data Applications: Utilize Apache Spark to create scalable and efficient Big Data applications.Collaborate with Data Scientists and Business Analysts: Work with cross-functional teams to understand requirements and translate them...
-
Big Data Developer
3 weeks ago
Chennai, India Hirexa Solutions Full timeJob Description :We are looking for an experienced Big Data Developer with strong expertise in Hadoop, Spark, Scala, and data pipeline development. The ideal candidate will have a solid background in big data technologies, scalable data processing, and API development, combined with hands-on skills in distributed computing. This role involves designing and...
-
Big Data Engineer
4 weeks ago
Bangalore/Pune/Mumbai/Chennai, India a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Big Data Engineer
2 months ago
Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Tech Anchor
2 months ago
Chennai, India TETRAHED INC Full timeMinimum Qualifications : BE or equivalent degree.Job Description : - 4+ years of experience with Bigquery, Python, any RDBMS, GCP Cloud Platform- Total 8 years of work experience and current or previous experience leading a team.- 3+ years of experience in Python to build data engineering pipelines using libraries- 3+ years of experience building out data...
-
Big Data Developer
4 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...
-
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeWe are seeking an experienced Data Engineer to join our team at RiskInsight Consulting Pvt Ltd. This role involves designing, developing, and deploying scalable Big Data applications using Apache Spark.ResponsibilitiesCollaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.Write efficient...