Data Engineer

1 week ago


Kollam, India Think AI Corporation, an Inc 5000 company Full time

About Us:

We are a leading company specializing in building Azure Fabric-based Modern Data Warehouses, leveraging cutting-edge technologies to provide scalable and efficient data solutions. Our processes involve advanced data engineering, Python for data cleaning and transformation, pipelines for data movement, and a strong focus on SQL for querying and managing data.


Position: Data Engineer

Experience: 2-3 Years

Location: Indore

Employment Type: Full-Time


Key Responsibilities:

Data Transformation and Loading:

Develop and maintain Python scripts for data cleansing, transformation, and validation.

Implement and monitor ETL processes to load data efficiently into Azure Fabric environments.

Pipeline Development:

Design, build, and optimize data pipelines using Azure Data Factory, Synapse Pipelines, or Microsoft Fabric Pipelines.

Ensure data movement is seamless across the medallion architecture's Bronze, Silver, and Gold layers.

Database Management and SQL Development:

Write complex SQL queries for data extraction, transformation, and analysis.

Optimize SQL scripts to improve performance and scalability.

Manage database schemas, tables, and views in the Fabric environment.

Data Quality and Validation:

Implement data validation checks to ensure data accuracy and consistency across all layers.

Troubleshoot and resolve data-related issues promptly.

Collaboration:

Work closely with business analysts, data architects, and other stakeholders to understand data requirements.

Collaborate with cross-functional teams to deliver robust and efficient data solutions.

Qualifications:

Education: Bachelor's degree in Computer Science, Data Engineering, or a related field.

Experience: 2-3 years of hands-on experience in data engineering roles.


Technical Skills:

Proficiency in Python for data cleansing and transformation.

Strong knowledge of SQL, with experience in writing complex queries and optimizing them.

Experience with Azure services, particularly Azure Data Factory, Synapse, or Microsoft Fabric.

Familiarity with the medallion architecture and data warehousing concepts.


Soft Skills:

Strong problem-solving abilities and attention to detail.

Good communication and teamwork skills.


Preferred Qualifications:

Experience in building data pipelines in a cloud environment.

Understanding of Delta tables and OneLake in Microsoft Fabric.

Knowledge of data governance and security practices.



  • Kollam, Kerala, India Enterprise Minds, Inc Full time

    We are seeking an experienced Data Engineering Leader to join our team at Enterprise Minds, Inc. This is a full-time position that offers a competitive salary of $180,000 - $250,000 per year.Job OverviewAs a Data Engineering Leader, you will be responsible for overseeing the design, development, and implementation of data solutions across Azure, AWS, and...

  • Big Data Engineer

    1 month ago


    kollam, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...


  • Kollam, Kerala, India Enterprise Minds, Inc Full time

    Job Title: Data Engineering Leader for Cloud PlatformsWe are seeking a highly skilled and experienced Data Engineering Leader to oversee the design, development, and implementation of data solutions across Azure, AWS, and Google Cloud platforms. The ideal candidate will lead a team of data engineers, ensuring the creation of scalable, high-performance data...


  • Kollam, Kerala, India Programmers Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Jaipur. As an AWS Data Engineer, you will play a crucial role in analyzing existing marketing data, developing data workflows, and ingesting unified data into OLTP databases.With 3-8 years of experience in AWS and data analysis, you will collaborate with our DE team to ingest...


  • Kollam, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...

  • Senior Data Scientist

    4 weeks ago


    Kollam, India Bidgely Full time

    Roles and Responsibilities ● Research and develop advanced statistical and machine learning models for analysis of large-scale, high-dimensional data. ● Dig deeper into data, understand characteristics of data, evaluate alternate models and validate hypothesis through theoretical and empirical approaches. ● Productize proven or working models into...

  • Data Scientist

    3 months ago


    kollam, India bluCognition Full time

    About bluCognition: bluCognition is an AI/ML based start-up specializing in risk analytics, data conversion and data enrichment capabilities. Founded in 2017, by some very named senior professionals from the financial services industry, the company is headquartered in the US, with the delivery center based in Pune. We build all our solutions while leveraging...

  • Big Data

    3 months ago


    Kollam, India Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...


  • Kollam, India Canopus Infosystems - A CMMI Level 3 Company Full time

    We are seeking a highly skilled Senior Product Analytics Engineer experienced in product data analysis to guide product strategy and drive business growth. In this role, you will be responsible for analyzing product and monitoring product performance while providing actionable insights to optimize product features and support successful product launches. You...

  • Engineering Manager

    1 month ago


    Kollam, India HuntingCube Recruitment Solutions Full time

    Position: Engineering Manager (Fullstack)Experience: 8 - 12 YearsSkills: React.js And Node/python/java/scala (Looking for frontend heavy profiles)Qualification: B.tech/BE/MCANotice Period: Upto 30 days onlyLocation: Permanent RemoteJob DescriptionYour responsibilitiesAs part of the team, you will be responsible to:Led the team for responsible successful...


  • Kollam, India Restored Cloud Full time

    Machine Learning Engineer - InfrastructureJob Description:As a Machine Learning Engineer specializing in infrastructure at Restored Cloud, you will design and build the tools, frameworks, and systems that enable efficient training, deployment, and scaling of machine learning models. You will work on cutting-edge challenges in model optimization,...


  • Kollam, Kerala, India SNA Technologies Full time

    About SNA TechnologiesWe are a global firm specializing in Enterprise Architecture solutions, offering consulting services for business, information systems, technology, and IT development. Our focus is on rejuvenating and transforming businesses through innovative IT strategies and solutions that are adaptable, scalable, agile, and change-responsive.Our...

  • Software Engineer

    1 month ago


    Kollam, India BayOne Solutions Full time

    ROLE SUMMARYAs an early member of the engineering team, you will play a key role in developing the core software and also maintaining & upholding the culture of brilliance in our tightly-knit organization.You will:- Develop and maintain data pipelines that are at the core of empowering the product's discovery and AI search capabilities.- Participate in the...


  • Kollam, India Talent Pulse 360 Full time

    PLEASE READ THE JOB DESCRIPTION CAREFULLY BEFORE APPLYINGOpportunityWe are seeking a highly skilled Full Stack Developer with expertise in building multi-agent Retrieval-Augmented Generation (RAG) systems and proficiency in prompt engineering. The ideal candidate should excel in backend development using Python, frontend development using Node.js, and...

  • Software Engineer

    3 weeks ago


    Kollam, India Synechron Full time

    We have opportunity for Postilion Developer Experience :5+ Years.Job Role: Senior Developer/Lead DeveloperJob Location: - Bangalore/Pune/HyderabadAbout Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital...


  • Kollam, Kerala, India Rippling Full time

    About RipplingWe're a pioneering technology company that's transforming the way businesses manage their HR and IT operations. Our unified workforce platform streamlines payroll, benefits, computers, apps, and more, automating manual work and empowering employers to focus on growth.With our cutting-edge platform, you can set up new employees' benefits,...

  • Sr Firmware Engineer

    3 weeks ago


    Kollam, India Connectpro Management Consultants Private Limited Full time

    Firmware Engineer, and you will design leading-edgeembedded firmware solutions for the data services industry, influence next generation active cable designin QSFP and OSFP platforms using innovative PHY chips in coordination with signal integrity designers and hardware engineers. You will be architecting, evaluating, and validating and/or designing...


  • Kollam, India Deliveroo Full time

    Who We AreOur ambition is to be the definitive food company, feeding people three times a day with great food from the World's best-loved restaurants, all with an unparalleled level of convenience.From distributed computing to large-scale system design, complex algorithms to beautiful user interfaces, we have teams working on every step of the journey to...


  • Kollam, India NCR Voyix Full time

    Dear Aspirant,We have active opening for Devops_Full time_Hyderabad_NCR VOYIX.Experience: 6+yrsLocation: HyderabadNotice period: Immediate -60daysCTC: As per normsSkills: Devops, GCP, Kubernetes, Linux,AWS.Job description:Understand the entire system end to end and involve in every step of software development process like designing, development, and...

  • Automation Engineer

    3 weeks ago


    Kollam, Kerala, India Synechron Full time

    At Synechron, we are seeking a highly skilled Automation Engineer to join our team in Kharadi, Pune. As an Automation Engineer, your role will be to write scripts to automate testing and create tools so developers can test their own code.Job DescriptionIn this role, you will be responsible for developing automated tests and test suites using object-oriented...