Senior Data Engineer

2 weeks ago

ahmedabad, India Anblicks Full time
Job Description:
Job Designation / Role: Senior Data Engineer (Snowflake)
Job Location : Ahmedabad/ Hyderabad
Role Objective:
We are seeking a skilled and driven Senior Data Engineer with a strong focus on Snowflake, Python, and data engineering concepts to join our team . The ideal candidate will possess deep expertise in designing, building, and optimizing data pipelines, leveraging Snowflake and PySpark to drive efficient data processing and analytics . As a key member of our team, you will collaborate closely with stakeholders to architect and implement scalable data solutions that meet the organization's needs.
Roles & Responsibilities :
• Design, develop, and optimize end-to-end data pipelines using Snowflake, PySpark, and Python .
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Implement best practices for data ingestion, transformation, and storage within the Snowflake environment.
• Develop and maintain ETL processes to ensure data quality, consistency, and reliability.
• Utilize PySpark for data processing tasks , including data cleansing, enrichment, and aggregation.
• Implement data validation and testing frameworks to ensure the accuracy and integrity of data pipelines.
• Optimize performance and scalability of data pipelines to meet SLAs and business requirements.
• Work closely with data scientists and analysts to support advanced analytics initiatives.
• Troubleshoot and debug issues with data pipelines, ensuring timely resolution.
• Stay updated on emerging technologies and trends in data engineering and cloud computing.
Skills & Experience Required:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in data engineering, with a focus on Snowflake, Python, and PySpark.
• Strong proficiency in SQL and experience working with Snowflake for data warehousing .
• Experience in working with Snowflake concepts like Snowpipe, Streams, Tasks, Cloning, TimeTravel, Data Sharing, Data Replication e.t.c.
• Expertise in Python programming , including experience with data manipulation, scripting, and automation.
• Hands-on experience with PySpark for distributed data processing and analytics.
• Solid understanding of data engineering concepts, including data modeling, ETL/ELT, and data integration.
• Experience with cloud platforms such as AWS or Azure , with a focus on Snowflake implementation.
• Familiarity with data visualization tools and techniques is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Proven ability to manage multiple tasks and priorities in a fast-paced environment.
• Experience working in an Agile development environment is preferred.
Education: BE/B.Tech, MCA, MSC, M.Tech

  • Senior DevOps Engineer

    1 month ago

    Ahmedabad, India Crest Data Systems Full time

    Senior DevOps Engineer Engineering Job Location(s) Ahmedabad and Pune, India Job Type Full time, Employee Duties and Responsibilities: Utilize various open source technologies Use various tools to orchestrate solutions Working closely with Development teams to implement and automate systems and architectures ...

  • AWS Data Engineer/Senior Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...

  • AWS Data Engineer/Senior Engineer

    1 month ago

    Ahmedabad, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...

  • Senior Software Engineer – Python

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description:We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST API using...

  • Senior Software Engineer – Python

    1 month ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST...

  • Senior Software Engineer – Python

    1 month ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing...

  • Senior Business Operations Executive

    2 days ago

    ahmedabad, India Crest Data Full time

    Key Skills :2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...

  • Senior Business Operations Executive

    3 days ago

    Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • Senior Business Operations Executive

    3 days ago

    ahmedabad, India Crest Data Full time

    Key Skills : 2-6 years of hands-on business operations experience within IT domain. Excellent Oral and written communication skills. Excellent presentation skills Degree in Science or Engineering Excellent knowledge of MS Excel, Word and PowerPoint Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...

  • Senior Business Operations Executive

    3 days ago

    Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • ▷ 15h Left: Senior Business Operations Executive

    6 hours ago

    Ahmedabad, India Crest Data Full time

    Key Skills:- 2-6 years of hands-on business operations experience within IT domain.- Excellent Oral and written communication skills.- Excellent presentation skills- Degree in Science or Engineering- Excellent knowledge of MS Excel, Word and PowerPoint- Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as...

  • Lead DevOps Engineer

    2 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Engineer/Senior Engineer

    2 weeks ago

    ahmedabad, India Arrow Electronics Full time

    *Position:* Engineer/Senior Engineer - Android *Job Description:* JD Points:* Core Java* Basic android functionality (Activity, fragment, singleton application, multi module application, single activity multi fragment)* MVVM, Navigation, Live Data, Event* Dagger (Any dependency injection tool)* Databinding Permission (User permission and System permission)*...

  • AWS Data Engineer/Senior Engineer

    3 weeks ago

    Ahmedabad, India Arrow Electronics Full time

    Description:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...

  • Senior Data Engineer

    1 day ago

    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Senior Data Engineer

    22 hours ago

    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Senior Data Engineer

    14 hours ago

    Ahmedabad, Gujarat, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • ▷ (Only 24h Left) Lead DevOps Engineer

    6 days ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • AWS Data Engineer/Senior Engineer

    1 month ago

    Ahmedabad, India Arrow Electronics Full time

    Description : Responsibilities:   Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and...

  • DataSlush - Data Engineer - SQL/Python

    4 weeks ago

    Ahmedabad, India IT Company Full time

    We are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...