Data Engineer

4 weeks ago

Palakkad, India Taiyō.AI Full time

About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors, engineering, procurement, construction, and infrainsurers) benchmark new project development opportunities, get a panoramic and dynamic view ofexternal risks, predict prices, identify drivers, and mitigate supply-side disruptions. We are seeking acandidate that is willing to learn and contribute to emerging technology and policy.Responsibilities:1. Work on data sourcing2. Use web scrapers (Beautifulsoup, selenium, etc.)3. Manage the data normalization and standards validation4. Parametrize and automate the scrapers5. Develop and execute the processes for monitoring data sanity and checking for data availabilityand reliability6. Understand the business drivers and build insights through data7. Work with the stakeholders at all levels to establish current and ongoing data support andreporting needs8. Ensure continuous data accuracy and recognize data discrepancies in systems that requireimmediate attention/escalation9. Work and become an expert in the company's data warehouse and other data storage tools,understanding the definition, context, and proper use of all attributes and metrics10. Create dashboards based on business requirements11. Work on the distributed systems, scale, cloud, caching, CI/CD (continuous integration anddeployment), distributed logging, data pipeline, REST API)Requirements:- Bachelor's degree in Computer Science, Engineering, or related field or must be completingtheir graduation in 2025- Proven experience in data engineering and ETL development.- Proficiency in programming languages such as Python, Java, or Scala.- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloudplatforms (e.g., AWS, Azure, GCP).- Strong SQL skills and experience with database systems.- Excellent problem-solving and analytical abilities.- Effective communication and collaboration skills.Benefits:- Competitive salary- Comprehensive benefits- Flexible schedule- Work from home option- Opportunities for rapid growth and career advancement- Exciting work culture with a focus on innovation and collaboration- Sense of ownership and impact in a dynamic organizationApply here: https://docs.google.com/forms/d/e/1FAIpQLSeHeVmkZ2h2KtQq2uisokZFrGNEVJT0UhWa8fBLZT27TyA08g/viewform?usp=sharing&ouid=109654441412058597015

  • Data Engineer

    4 weeks ago

    Palakkad, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Job Title: Data Engineer Location: RemotePosition: Full-timeExp- Must Have 8+ YearsPosition OverviewWe are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data...

  • Cloud Data Engineer

    46 minutes ago

    palakkad, India beBeeDataEngineer Full time

    About the RoleWe are seeking an experienced data engineer to design, develop, and maintain cloud-based data pipelines and analytics solutions using AWS services.The ideal candidate should have strong skills in Python and SQL, with advanced knowledge of data engineering principles and practices.The selected candidate will work closely with our team to:Design...

  • Azure data engineer

    5 days ago

    Palakkad, India SystemBender Full time

    *Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with Py Spark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (Py Spark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...

  • Technical Project Manager-Data Engineering

    3 weeks ago

    Palakkad, India Reflections Info Systems Full time

    We are looking for 13+years experienced candidates for this role.Mode: HybridPreferred Location: Cochin/Trivandrum/ChennaiPrimary Skills :- Overall 13+ Years of Experience in IT with 6+ years of experience as a Technical Product Manager, Technical Program Manager, or Delivery Lead. - Hands-on development experience in data engineering, including data...

  • Azure Data Services Engineer – Microsoft Fabric

    2 weeks ago

    Palakkad, India Gravity Infosolutions, Inc. Full time

    Position: Azure Data Engineer – Microsoft FabricExperience: 6+ yearsLocation: RemoteJob Summary:We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem. The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and business insights across...

  • Data Systems Architect

    2 days ago

    palakkad, India beBeeAutomation Full time

    Data Engineering OpportunityJob Description:The role of a data engineer is to design, build, and maintain the infrastructure that stores and processes large-scale data. This includes creating data pipelines, integrating various data systems, and ensuring data quality and integrity.Required Skills and Qualifications:Deep hands-on experience with Unity...

  • Opening for Senior GCP Data Engineer @ Remote

    6 days ago

    Palakkad, India Quess IT Staffing Full time

    Hi,Exp: 8+ YearsEssential Skills:6+ years of professional experience in data engineering or a similar role.Hands-on experience with Google Cloud Platform (GCP) services (BigQuery, Cloud Run, Scheduler).Proficiency in SQL for data manipulation and analysis.Experience with dbt.Familiarity with infrastructure-as-code principles.Strong programming skills in...

  • Enterprise Data Architect

    4 weeks ago

    Palakkad, India DBiz.ai Full time

    The Enterprise Data Architect/Data Modeler is a senior technical leader responsible for defining, designing and governing the organization’s enterprise data architecture. You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI/ML initiatives at scale. You will work closely with business...

  • Enterprise Data Architect

    4 weeks ago

    Palakkad, India DBiz.ai Full time

    The Enterprise Data Architect/Data Modeler is a senior technical leader responsible for defining, designing and governing the organization’s enterprise data architecture. You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI/ML initiatives at scale. You will work closely with business...

  • Snowflake data developer

    2 weeks ago

    Palakkad, India E4 Software Services Pvt. Ltd Full time

    About the Role: We are seeking an experienced Snowflake Developer with strong hands-on expertise to design, implement, and optimize data solutions on the Snowflake Data Cloud platform. The ideal candidate will demonstrate deep proficiency in SnowSQL, performance optimization, and advanced data engineering using SQL and Python. Location...