Data Engineer Python PySpark Apache Airflow NoSQL

Data Engineer(Python PySpark Apache Airflow NoSQL)Location: Bengaluru Karnataka India (Onsite)Experience: 35yearsResponsibilities:Build optimize and maintain scalable ETL pipelines for dataingestion and processing. Develop and manageworkflows using Apache Airflow for scheduling and orchestratingtasks. Work with distributed computingtechnologies (PySpark) to...

About the RoleWe are seeking a highly skilled Data Engineer to join our team at CuberaTech. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures using Python, PySpark, and Apache Airflow. You will work closely with our data scientists and analytics teams to ensure data quality and...

About the RoleWe are seeking a highly skilled Data Engineer to join our team at CuberaTech. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Python, PySpark, and Apache Airflow.Key ResponsibilitiesDesign and implement scalable data pipelines using Python and PySparkDevelop and...

Responsibilities : - Build data collection pipelines that can acquire and handle millions of public data points from various sources using APIs and web extraction techniques at scale. - Build the data cleaning and preprocessing pipelines in the platform leveraging AWS services such as Lambda, S3 EC2 PostgreSQL, Elasticsearch, etc. - Iterative improvements to...

Responsibilities : Data Pipeline Development : Design, implement, and maintain scalable data pipelines using PySpark to process and transform large datasets efficiently.Workflow Orchestration : Develop, schedule, and monitor complex data workflows and ETL processes using Apache Airflow.Data Management : Manage and optimize data storage solutions, ensuring...

Job Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...

About the RoleCuberaTech is a data company revolutionizing Big Data Analytics through a data value share paradigm. We are looking for an experienced Data Engineering Specialist to join our team in Bengaluru, Karnataka. The ideal candidate will have strong proficiency in Python, PySpark, and SQL, as well as experience working with Apache Airflow for...

As an **Azure IoT with Apache Airflow Engineer** at **InnoWave**, you will be a key member of our IoT solutions team, responsible for designing, developing, and maintaining robust and scalable data processing pipelines. You will leverage Azure IoT services and Apache Airflow to build efficient workflows that enable real-time data ingestion, processing, and...

Job Title: Data ArchitectAbout the Role:CuberaTech is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing scalable data architectures that meet the growing business needs of our company. You will work closely with our data engineering team to ensure that our data systems are...

About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Gethyr. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines using PySpark to process and transform large datasets efficiently.Key Responsibilities:Design and implement scalable data...

About the Role:As a Data Architect at ConsultBae India Private Limited, you will be responsible for designing and implementing scalable ETL pipelines for data ingestion and processing. You will work with distributed computing technologies like PySpark to handle large-scale datasets and develop workflows using Apache Airflow for scheduling and orchestrating...

Job Title: Principal Data EngineerAbout the Role:We are seeking a highly skilled Principal Data Engineer to join our team at Gethyr. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines using PySpark to process and transform large datasets efficiently.Key...

Job Title: Principal Data EngineerAbout the Role:We are seeking a highly skilled Principal Data Engineer to join our team at Gethyr. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines using PySpark to process and transform large datasets efficiently.Key...

Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced SQL....

Job Title: AWS Big Data EngineerAbout the Role:We are seeking an experienced AWS Big Data Engineer to join our team at ScaleneWorks. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies, with extensive experience in PySpark, SQL, Spark, and Airflow.Key Responsibilities:• Design and develop big data...

1 Role** Airflow Python Developer 2 Required Technical Skill Set** Airflow, Kubernetes, Python, SQL 3 No of Requirements** 2 4 Desired Experience Range** 4+Years 5 Location of Requirement Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) Design and develop scalable pipelines with Apache...

1 Role** Airflow Python Developer2 Required Technical Skill Set** Airflow, Kubernetes, Python, SQL3 No of Requirements** 24 Desired Experience Range** 4+Years5 Location of Requirement BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not bemore than 3-5) Design and develop scalable pipelines with Apache AirflowHands on...

Key SkillsAt Global Pharma Tek, we're seeking a skilled Data Engineer for Cloud Data Platforms to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our cloud-based data infrastructure using Informatica, AWS Glue, and dbt. You will also work closely with our data scientists to develop...