Data engineer

4 weeks ago

Madurai, India Canopus Infosystems - A CMMI Level 3 Company Full time

Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web scraping, and generating actionable insights through dashboards and reports.Key Responsibilities:Develop, test, and maintain efficient Python scripts for data collection and transformation.Design and implement web scraping solutions to extract structured and unstructured data from diverse sources.Perform data cleaning, preprocessing, and analysis to identify patterns, trends, and insights.Work with SQL and No SQL databases for efficient data storage, retrieval, and manipulation.Create and maintain interactive dashboards and visualizations to present metrics and business insights to stakeholders.Collaborate with cross-functional teams to understand business needs and translate them into data-driven solutions.Optimize existing data workflows and pipelines for performance and scalability.Document code, workflows, and methodologies for clarity and maintainability.Required Skills & Qualifications:Bachelor’s degree in Computer Science, Data Science, or a related field, or equivalent practical experience.Minimum 2 years of professional experience as a Data Engineer or in a similar role.Strong proficiency in Python and key data libraries (Pandas, Num Py, Scikit-learn).Hands-on experience with web scraping tools and libraries (Scrapy, Beautiful Soup, Selenium).Solid understanding of databases with strong SQL skills; exposure to databases like Postgre SQL, Mongo DB is a plus.Experience with data visualization libraries (Matplotlib, Seaborn, Plotly) and/or BI tools (Power BI, Tableau, Looker).Strong problem-solving ability, analytical mindset, and keen attention to detail.Experience using version control systems (Git).Preferred Qualifications:Exposure to cloud platforms such as AWS, Google Cloud Platform (GCP), or Azure.Familiarity with REST APIs for data collection and integration.Understanding of data warehousing concepts.Prior experience working in an Agile development environment.

  • Data Engineer

    3 weeks ago

    Madurai, India Peoplefy Full time

    Responsibilities:Lead the design and development of scalable data pipelines using AWS (Glue, Redshift, Athena) Drive architecture decisions for data systems that support business analytics and application features Build end-to-end solutions, including backend APIs and, where applicable, simple UI components Orchestrate workflows using Airflow or equivalent...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Senior Data Engineer with Azure Data Factory (ADF), Azure Databricks, SQL, PythonLocation: MaduraiExperience: 3 to 8 yearsJob SummaryThe Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    3 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 weeks ago

    Madurai, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineer

    7 days ago

    Madurai, Tamil Nadu, India Pinnacle Infotech Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • AWS Data Engineer

    7 days ago

    Madurai, Tamil Nadu, India Techmango Technology Services Private Limited Full time ₹ 80,00,000 - ₹ 2,40,00,000 per year

    About TechMango:Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs.We specialize in providing custom software solutions using the best available technologies,...

  • Senior Data Engineer

    3 weeks ago

    Madurai, India Manuh Technologies Full time

    Required Qualifications5+ years of professional experience in data engineering, data science engineering, or related fields.Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.Proven expertise as a Data Modeler (conceptual, logical, and physical...