Senior Data Engineer
1 month ago
Job Description:
Job Designation / Role: Senior Data Engineer (Snowflake)
Job Location: Ahmedabad/ Hyderabad
Role Objective:
We are seeking a skilled and driven Senior Data Engineer with a strong focus on Snowflake, Python, and data engineering concepts to join our team. The ideal candidate will possess deep expertise in designing, building, and optimizing data pipelines, leveraging Snowflake and PySpark to drive efficient data processing and analytics. As a key member of our team, you will collaborate closely with stakeholders to architect and implement scalable data solutions that meet the organization's needs.
Roles & Responsibilities :
• Design, develop, and optimize end-to-end data pipelines using Snowflake, PySpark, and Python.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Implement best practices for data ingestion, transformation, and storage within the Snowflake environment.
• Develop and maintain ETL processes to ensure data quality, consistency, and reliability.
• Utilize PySpark for data processing tasks, including data cleansing, enrichment, and aggregation.
• Implement data validation and testing frameworks to ensure the accuracy and integrity of data pipelines.
• Optimize performance and scalability of data pipelines to meet SLAs and business requirements.
• Work closely with data scientists and analysts to support advanced analytics initiatives.
• Troubleshoot and debug issues with data pipelines, ensuring timely resolution.
• Stay updated on emerging technologies and trends in data engineering and cloud computing.
Skills & Experience Required:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in data engineering, with a focus on Snowflake, Python, and PySpark.
• Strong proficiency in SQL and experience working with Snowflake for data warehousing.
• Experience in working with Snowflake concepts like Snowpipe, Streams, Tasks, Cloning, TimeTravel, Data Sharing, Data Replication e.t.c.
• Expertise in Python programming, including experience with data manipulation, scripting, and automation.
• Hands-on experience with PySpark for distributed data processing and analytics.
• Solid understanding of data engineering concepts, including data modeling, ETL/ELT, and data integration.
• Experience with cloud platforms such as AWS or Azure, with a focus on Snowflake implementation.
• Familiarity with data visualization tools and techniques is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Proven ability to manage multiple tasks and priorities in a fast-paced environment.
• Experience working in an Agile development environment is preferred.
Education: BE/B.Tech, MCA, MSC, M.Tech
-
Senior DevOps Engineer
1 month ago
Ahmedabad, India Crest Data Systems Full timeSenior DevOps Engineer Engineering Job Location(s) Ahmedabad and Pune, India Job Type Full time, Employee Duties and Responsibilities: Utilize various open source technologies Use various tools to orchestrate solutions Working closely with Development teams to implement and automate systems and architectures ...
-
AWS Data Engineer/Senior Engineer
4 weeks ago
Ahmedabad, Gujarat, India Arrow Electronics Full timePosition:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...
-
AWS Data Engineer/Senior Engineer
1 month ago
Ahmedabad, India Arrow Electronics Full timePosition:AWS Data Engineer/Senior EngineerJob Description:Responsibilities:Â Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...
-
Senior Software Engineer – Python
4 weeks ago
Ahmedabad, India Crest Data Systems Full timeJob Description:We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST API using...
-
Senior Software Engineer – Python
1 month ago
ahmedabad, India Crest Data Systems Full timeJob Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing...
-
Senior Software Engineer – Python
1 month ago
Ahmedabad, India Crest Data Systems Full timeJob Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST...
-
Senior Business Operations Executive
3 days ago
ahmedabad, India Crest Data Full timeKey Skills :2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...
-
Senior Business Operations Executive
4 days ago
ahmedabad, India Crest Data Full timeKey Skills : 2-6 years of hands-on business operations experience within IT domain. Excellent Oral and written communication skills. Excellent presentation skills Degree in Science or Engineering Excellent knowledge of MS Excel, Word and PowerPoint Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...
-
Senior Business Operations Executive
3 days ago
Ahmedabad, India Crest Data Full timeKey Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...
-
Senior Business Operations Executive
3 days ago
Ahmedabad, India Crest Data Full timeKey Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...
-
▷ 15h Left: Senior Business Operations Executive
12 hours ago
Ahmedabad, India Crest Data Full timeKey Skills:- 2-6 years of hands-on business operations experience within IT domain.- Excellent Oral and written communication skills.- Excellent presentation skills- Degree in Science or Engineering- Excellent knowledge of MS Excel, Word and PowerPoint- Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as...
-
Lead DevOps Engineer
2 weeks ago
ahmedabad, India Crest Data Full timeCompany Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
Engineer/Senior Engineer
2 weeks ago
ahmedabad, India Arrow Electronics Full time*Position:* Engineer/Senior Engineer - Android *Job Description:* JD Points:* Core Java* Basic android functionality (Activity, fragment, singleton application, multi module application, single activity multi fragment)* MVVM, Navigation, Live Data, Event* Dagger (Any dependency injection tool)* Databinding Permission (User permission and System permission)*...
-
AWS Data Engineer/Senior Engineer
4 weeks ago
Ahmedabad, India Arrow Electronics Full timeDescription:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...
-
Senior Data Engineer
2 days ago
Ahmedabad, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
Senior Data Engineer
1 day ago
Ahmedabad, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
Senior Data Engineer
21 hours ago
Ahmedabad, Gujarat, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
AWS Data Engineer/Senior Engineer
1 month ago
Ahmedabad, India Arrow Electronics Full timeDescription : Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and...
-
▷ (Only 24h Left) Lead DevOps Engineer
7 days ago
Ahmedabad, India Crest Data Full timeCompany Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
DataSlush - Data Engineer - SQL/Python
4 weeks ago
Ahmedabad, India IT Company Full timeWe are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...