Data Engineer

5 days ago

Ahmedabad, Gujarat, India Huptech HR Solutions Full time

Job Post : Sr. Data Engineer (Azure). Experience : 5 years. Location : Ahmedabad (Hybrid Model). Responsibilities : - Design, develop, and maintain scalable and efficient data pipelines using industry standard tools and technologies. - Implement and optimize ETL processes to ensure data quality, reliability, and performance. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver robust data solutions. - Utilize Apache Spark for largescale data processing and analysis. - Manage containerized applications using Docker and orchestrate them with Kubernetes. - Automate workflows and data pipelines using Apache Airflow. - Leverage Azure cloud services for data storage, processing, and analytics. - Design and maintain SQL Server databases, ensuring high availability and performance. - Implement data quality checks using Great Expectations to ensure data accuracy and consistency. - Contribute to the overall system design and architecture, ensuring scalability and maintainability. - Troubleshoot and resolve data related issues, ensuring minimal downtime and data loss. - Stay current with emerging trends and technologies in data engineering and propose new solutions to enhance the data : - 5 years of experience in data engineering or a related field. - Proficient in Python for data manipulation and automation. - Hands-on experience with Apache Spark for big data processing. - Extensive experience with Docker for containerization and Kubernetes for orchestration. - Proficient in using Apache Airflow for workflow automation. - Strong experience with Azure cloud services (i.e., Azure Data Lake, Azure SQL Database, Azure Databricks). - Expertise in SQL Server databases, including design, optimization, and management. - Familiarity with data quality tools like Great Expectations. - Solid understanding of system design principles and best practices. - Excellent problem-solving skills and attention to detail. - Strong communication skills and the ability to work collaboratively in a team environment. (ref:hirist.tech)

  • Chief Data Architect Snowflake

    6 days ago

    Ahmedabad, Gujarat, India Data Actions Full time

    Data Actions is seeking a highly skilled Senior Snowflake Developer to join our team. With 8+ years of experience in data engineering and at least 2 years working with Snowflake, this role requires designing, developing, and optimizing Snowflake implementations.Key Responsibilities:

  • Software Engineering Manager

    2 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    About Us:Crest Data is a dynamic and innovative company that provides cutting-edge data center solutions and engineering/marketing services. Our team of experts has extensive experience in building and deploying various Data Center products and services.

  • Senior Software Engineer/Technical Lead

    7 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior software engineer/technical lead

    2 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS, EMC,...

  • High-Performance Software Development Engineer

    7 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Job Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services. We offer cutting-edge expertise in Networking, SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data/Data Analytics.Our team has extensive experience building and deploying innovative Data Center products from top global hi-tech...

  • DevOps Engineering Specialist

    1 day ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Job DescriptionAs a Senior DevOps Engineer at Crest Data, you will play a pivotal role in driving automation efforts across the organization or customer utilizing Infrastructure as Code (IaC), Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins and Bamboo.You will be responsible for:Configuring and...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Mobio Solutions Full time

    Position : Data EngineerJob Responsibilities :- Design, implement, and optimize big data pipelines in Databricks.- Develop scalable ETL workflows to process large datasets.- Leverage Apache Spark for distributed data processing and real-time analytics.- Implement data governance, security policies, and compliance standards.- Optimize data lakehouse...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India SWASTIK PLACEMENT AGENCY Full time

    Job DescriptionQualifications and Skills- Bachelor's degree in Computer Science, Engineering, or a related field- 1 to 3 years of experience in data engineering or a similar role- Strong knowledge of SQL and database concepts- Experience with data integration and ETL tools- Familiarity with data warehousing and data modeling- Proficiency in programming...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India SWASTIK PLACEMENT AGENCY Full time

    Qualifications and SkillsBachelor's degree in Computer Science, Engineering, or a related field1 to 3 years of experience in data engineering or a similar roleStrong knowledge of SQL and database conceptsExperience with data integration and ETL toolsFamiliarity with data warehousing and data modelingProficiency in programming languages such as Python or...

  • Senior DevOps Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Key...

  • Senior DevOps Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Key...

  • Senior DevOps Engineer

    3 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : http://www.crestdata.ai Job Location -...

  • Advanced Network Operations Engineer

    15 hours ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Crest Data is looking for an Advanced Network Operations Engineer to enhance our network infrastructure.The successful candidate will have 5+ years of experience in network administration and a strong ability to troubleshoot and resolve complex network issues.Responsibilities include configuring and managing network devices, including switches, routers,...

  • Senior DevOps Engineer

    2 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: Job Location- AhmedabadKey...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India LinkMD Full time

    Job Title: Data Engineer Location: Ahmedabad, Gujarat, India Job Type: Full-time Experience Level: 3+ years Salary Range: 10-15 LPA Job Summary: We are looking for a skilled and driven Data Engineer to join our dynamic team at an innovative healthcare startup. You will play a critical role in architecting, developing, and optimizing robust data...

  • Senior DevOps Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL:Job Location- AhmedabadKey Responsibilities...

  • Senior DevOps Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Lead Python Engineer

    5 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Technical ExpertiseWe are seeking an experienced Sr. Python Engineer who can drive technical development and delivery. You will be responsible for providing expertise in software development life cycles, leading small-sized teams, and ensuring code reviews and best practices are followed. Your experience with Python frameworks like Django or Flask, front-end...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Krayr Solutions Full time

    Role – Data Engineer 3+ Years' experience Location – Ahmedabad Mandatory skills- Fivetran, Python, AWS Requirements Qualified candidate must have: ● Bachelor's Degree ● Minimum 3-5 years of experience in data engineering. ● Must have experience in fivetran ( Python scripting, AWS Lambda ● Expertise in database such as Progres, Mongo DB, MySQL ●...