Cloud Data Engineer
11 hours ago
Overview Bright Tier Solutions is seeking a highly skilled Cloud Engineer with a strong background in cloud platforms like AWS, Azure, and GCP. The ideal candidate will be proficient in designing, implementing, and maintaining scalable ETL pipelines and data lakes using a variety of cloud-native tools. This role demands expertise in data platforms like Redshift, Snowflake, Databricks, and Synapse, with a focus on optimizing data ingestion and transformation processes. Familiarity with data extraction from SAP or ERP systems is a plus.
Key Responsibilities: Design and Development: - Design, develop, and maintain scalable ETL pipelines using cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, and GCP Dataflow. - Architect and implement data lakes and data warehouses on platforms such as AWS, Azure, and GCP. - Develop and optimize data ingestion, transformation, and loading processes using platforms like Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse. - Implement ETL processes with tools like Informatica, SAP Data Intelligence, and others. Data Integration and Management: - Integrate various data sources including relational databases, APIs, unstructured data, and ERP systems into the data lake. - Ensure data quality and integrity through rigorous testing and validation. - Perform data extraction from SAP or ERP systems when necessary.
Performance Optimization: - Monitor and optimize the performance of data pipelines and ETL processes. - Implement best practices for data governance, security, and compliance.
Collaboration: - Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and design data solutions. - Partner with stakeholders to deliver high-quality, efficient cloud data solutions aligned with business needs.
Documentation and Maintenance: - Document all technical solutions, processes, and workflows. - Maintain, troubleshoot, and optimize existing ETL pipelines and data integrations.
Required Qualifications:
- Education: Bachelor's degree in Computer Science, Information Technology, or a related field (Advanced degrees are a plus).
- Experience: - 7+ years of experience in a Data Engineer or Cloud Engineer role. - Extensive experience with cloud platforms like AWS, Azure, and GCP. - Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. - Proficiency in data platforms like Redshift, Snowflake, Databricks, BigQuery, and Azure Synapse. - Experience with SAP or ERP systems data extraction is a plus. - Strong experience with Spark and Scala for data processing.
Key Skills:
- Strong programming skills in Python, Java, or Scala. - Proficient in SQL and query optimization techniques. - Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts. - Knowledge of data governance, security, and compliance best practices. - Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications:
- Experience with additional data tools and technologies such as Apache Spark or Hadoop. - Certifications in cloud platforms (e.g., AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate). - Experience with CI/CD pipelines and DevOps practices for data engineering.
-
Data Engineer
4 days ago
India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...
-
Lead Data Engineer
3 days ago
India Data Science Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMUST HAVE• Minimum of 4+ years of Azure DE experience • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...
-
Cloud Data Engineer
2 days ago
india, india Lemongrass Full timeAbout Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...
-
Cloud Data Engineer
4 weeks ago
india Lemongrass Full timeAbout Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...
-
Cloud Data Engineer
2 weeks ago
India Lemongrass Full timeAbout LemongrassLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...
-
Cloud Data Engineer
3 weeks ago
India Lemongrass Full timeAbout Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...
-
Cloud Data Engineer
2 weeks ago
India Lemongrass Full timeAbout Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...
-
Data Engineer
5 days ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...
-
Cloud Data Engineer
2 days ago
India Bright Tier Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing,...
-
Cloud Data Engineer
2 days ago
India Vodafone Full time ₹ 6,00,000 - ₹ 18,00,000 per yearWho we are At Vodafone, we're not just shaping the future of connectivity for our customers – we're shaping the future for everyone who joins our team. When you work with us, you're part of a global mission to connect people, solve complex challenges, and create a sustainable and more inclusive world. If you want to grow your career whilst finding the...
