Senior Cloud Data Engineer
1 month ago
Circuit Compilers seeks a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Python, Scala, and PySpark to process and transform large volumes of structured and unstructured data.
Key responsibilities include:
- Developing and maintaining scalable data pipelines using Python, Scala, and PySpark to process and transform large volumes of structured and unstructured data.
- Designing and implementing data architectures that meet the needs of our business stakeholders.
- Collaborating with data scientists to integrate machine learning algorithms into Spark workflows, enabling advanced data analysis and predictive modeling.
- Optimizing Spark jobs by tuning configuration parameters, optimizing data partitioning, and leveraging in-memory caching techniques, resulting in significant performance improvements.
Requirements:
- 5 to 8 years of experience in build release management, software configuration, design, development, and cloud implementation.
- Expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline.
- Experience with data migration and handling large volumes of data efficiently.
- Understanding of AWS security features such as IAM roles and policies.
- AWS certification in AWS is highly preferred.
Circuit Compilers is an equal opportunities employer and welcomes applications from all qualified candidates.
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
3 days ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Senior Cloud Data Engineer
1 month ago
Anywhere in India/Multiple Locations Techwaukee Full timeJob Description:As a Senior Cloud Data Engineer at Techwaukee, you will play a crucial role in designing and implementing scalable data architectures on Google Cloud Platform (GCP).Key Responsibilities:Lead the development of data pipelines using GCP Dataflow and Cloud Pub/Sub.Design and implement data quality frameworks and data governance...
-
Senior Data Engineer
2 hours ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob SummaryWe are seeking an experienced Senior Data Engineer - Cloud Architecture to join our team at IT Source Global. This is a fantastic opportunity for a skilled data engineer to design, develop, and deploy scalable cloud-based data pipelines using AWS Glue, Python, and PySpark.About the RoleThe Senior Data Engineer will be responsible for:Designing and...
-
Cloud Data Engineer
1 month ago
Anywhere in India/Multiple Locations Naukari Wale Full timeJob Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Naukari Wale. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and...
-
Senior Data Engineer
1 month ago
Anywhere in India/Multiple Locations DoublU Pty Ltd Full timeJob OverviewWe are seeking a skilled GCP Data Engineer to design, build, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP).The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and ready for analysis.Key Responsibilities- Design, develop,...
-
Data Engineer
1 month ago
Remote/Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeSenior Data Engineer - ETLAt D-TechWorks Pvt Ltd, we are seeking an experienced Senior Data Engineer - ETL to join our team. The ideal candidate will have a strong background in designing and developing cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.Key Responsibilities:• Design and develop scalable...
-
Senior Cloud Infrastructure Engineer
1 month ago
Anywhere in India/Multiple Locations Robosoft Technologies Full timeJob Title: Senior Cloud Infrastructure EngineerAt Robosoft Technologies, we are seeking an experienced Senior Cloud Infrastructure Engineer to join our team of cloud experts. The ideal candidate will have a strong background in designing and implementing scalable, secure, and highly available cloud infrastructure on AWS.The Senior Cloud Infrastructure...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob Title: Cloud Data EngineerJob Summary:IT Source Global is seeking a highly skilled Cloud Data Engineer to design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL. The ideal candidate will have extensive experience working with AWS services such as Amazon S3 and Athena, as well as Azure Databricks.Key...
-
Senior Data Engineer
1 month ago
Anywhere in India/Multiple Locations Gen Full timeJob Title: Senior Data EngineerGenpact is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.We are seeking a Senior Data Engineer to join our team at Genpact. As a key...
-
Cloud Data Solutions Engineer
2 hours ago
Anywhere in India/Multiple Locations Naukari Wale Full timeNaukari Wale is seeking a skilled Cloud Data Solutions Engineer to join our team.Job DescriptionWe are looking for an experienced professional to design, build, and maintain large-scale data engineering platforms on Azure. The ideal candidate will have strong expertise in cloud computing, data architecture, and software development using Python and SQL.The...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Symphoni HR Full timeData Engineer Job DescriptionAs a Data Engineer at Symphoni HR, you will play a crucial role in designing, developing, and maintaining robust data pipelines and data warehouses.Key Responsibilities:Design, develop, and implement scalable data pipelines using Snowflake and other relevant tools to transform raw data into valuable insights.Extract, transform,...
-
Anywhere in India/Multiple Locations Aexonic Technologies Private Limited Full timeJob SummaryWe are seeking a highly skilled Senior Big Data Engineer to join our team at Aexonic Technologies Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.Key ResponsibilitiesDesign and develop...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations ADQ Services Full timeJob Description : Collaboration and Partnering : We are seeking a highly experienced and innovative Cloud Data Engineer to join our team at ADQ Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable Extract, Transform, and Load (ETL) pipelines utilizing various technologies.Key...
-
Senior Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations Bilwaa Technologies Full time**Job Title:** Senior Azure Data Engineer**Company Overview:** Bilwaa Technologies Pvt Ltd is a leading IT service-based organization in India, with over 20 years of experience in various domains including Banking, Healthcare, eCommerce, and Telecom.**Job Summary:** We are seeking a highly skilled Senior Azure Data Engineer to design and develop...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Aricent Full timeJob Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : Cloud/Data ManagementJob Description :- Hold a Bachelor’s degree or diploma in Computer Science, Software Engineering, or Software Architecture; candidates with substantial industry experience are also eligible.- 2+ years of relevant engineering experience in Cloud/IT field.-...
-
Senior Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Title: Senior Big Data EngineerJob Summary:US Technology International Pvt Ltd is seeking a Senior Big Data Engineer to lead the development and implementation of big data solutions. The ideal candidate will have expertise in Hadoop, Spark, and other big data technologies, as well as strong leadership and communication skills.Key Responsibilities:Design,...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN DoublU Pty Ltd Full timeJob Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...
-
Excelra Data Engineer
1 month ago
Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full timeData Engineer RoleWe are seeking a highly skilled Data Engineer with expertise in cloud platforms, data technologies, and ontologies to join our team at Excelra Knowledge Solutions.Key ResponsibilitiesDesign, implement, and manage cloud-based solutions on AWS and Azure.Develop and maintain scalable data pipelines for efficient data extraction,...