Data Warehouse Engineer

3 weeks ago


Tamil Nadu, India Syncpoint360 Full time

We are seeking a talented Data Engineer to join our team and play a key role in building and maintaining client data infrastructure. Ideal candidates should have a strong background in data warehousing, ETL processes, cloud technologies, and Python programming.


Responsibilities


  • Work closely with data scientists, analysts, and stakeholders to understand data requirements and ensure the availability and reliability of data for analysis and reporting.
  • Utilize the Snowflake data warehouse platform to design and optimize data models, schemas, and queries for efficient data storage and retrieval.
  • Implement data processing tasks using Python programming language and relevant libraries (e.g., Pandas, NumPy) to perform data manipulation, cleansing, and aggregation.
  • Develop and manage data workflows and scheduling tasks using Apache Airflow framework to automate and orchestrate data pipeline activities.
  • Write SQL queries for data extraction, transformation, and analysis, as well as optimize SQL queries for performance and scalability.
  • Utilize AWS cloud services such as S3, Redshift, Glue, and Lambda for data storage, processing, and serverless computing.
  • Implement real-time data processing and streaming analytics using Apache Spark and Kafka for handling high-volume, high-velocity data streams.
  • Containerize data applications and services using Docker for easy deployment, scaling, and management, and orchestrate containerized applications using Kubernetes for container scheduling, scaling, and automation.
  • Utilize version control systems like Git for managing codebase, collaborating with team members, and ensuring code quality and reliability.


Qualifications


  • Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred.
  • Proven experience as a Data Engineer or similar role, with a strong focus on data warehousing, ETL, and cloud technologies.
  • Proficiency in Python programming language and experience with relevant libraries/frameworks for data engineering tasks.
  • Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Hands-on experience with the Snowflake data warehouse platform and expertise in designing and optimizing data models and queries.
  • Familiarity with Apache Airflow framework for building and managing data workflows and scheduling tasks.
  • Knowledge of AWS cloud services and experience in building data solutions using services like S3, Redshift, Glue, Lambda, etc.
  • Experience with Apache Spark and Kafka for real-time data processing and streaming analytics.
  • Understanding of microservices architecture principles and hands-on experience in designing and deploying microservices-based data applications.
  • Proficiency in containerization technologies such as Docker and container orchestration platforms like Kubernetes.
  • Familiarity with version control systems like Git and experience with code reviews, branching strategies, and continuous integration/continuous deployment (CI/CD) pipelines.

  • Warehouse Incharge

    17 hours ago


    Vilan Gudi, Madurai, Tamil Nadu, India Solaimalai group of company Full time

    **Requirements**: - Hands on experience with warehouse management software and databases - Leadership skills and ability manage staff - Strong decision making and problem-solving skills - Expertise in warehouse management procedures and best practices - Proven ability to implement process improvement initiatives - Excellent communication skills -...

  • Senior Engineer

    7 days ago


    tamil nadu, India Tiger Analytics Full time

    Role: Senior Engineer – Quality EngineeringWork Location – Chennai, Bangalore or HyderabadTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 4000+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a...

  • Lead Data Architect

    4 days ago


    tamil nadu, India W Talent Full time

    We are looking for a passionate Lead Information Architect, who will play a leading role in ensuring that the businesses architects and builds solutions that deliver FAIR data products enabling both digital and data/AI.You will lead activities to define the information architecture for the domain, including data models, master data strategies, metadata...


  • tamil nadu, India Agilisium Consulting Full time

    Are you an architect passionate about building secure, scalable data lakes on AWS? Do you thrive in collaborating and leading to achieve peak data performance! If so, we want to hear from you!We're seeking a highly experienced Data Architect to join our growing team. In this role, you will leverage your deep knowledge of AWS cloud services to design, build,...

  • Data Engineer

    24 hours ago


    tamil nadu, India BU Soft Tech Full time

    Experience - 3 to 4 yrs as Data EngineerTech Stack - Python, Pyspark, SQL, AWS &Bachelor's degree in Computer Science, Engineering, or related field.Excellent written and verbal communication skills.Location - ChennaiRole DescriptionThis is a full-time on-site role for a Data Engineer at BU Soft Tech in Chennai. As a Data Engineer, you will be responsible...

  • Data Engineer

    2 weeks ago


    tamil nadu, India Movate Full time

    Role: Azure Data Engineer/ScientistLocation: India (Chennai, Bangalore, Hyderabad)Years of Experience : 5 – 7 YearsWork Mode : Work From OfficeResponsibilities:and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics.insights and provide data-driven recommendations.predictive and prescriptive models using tools from data...

  • Data Engineer

    7 days ago


    tamil nadu, India Blackstraw.ai Full time

    Data EngineerCompany Name: Blackstraw.aiOffice Location: Chennai (Work from Office)Job Type: Full-timeExperience: 4+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll...

  • Full Stack Engineer

    2 weeks ago


    tamil nadu, India Innoware Technologies Pty Ltd Full time

    We are seeking a talented and experienced Full-Stack Software Engineer to join our dynamic team in a hybrid working environment. As a key member of our organisation, you will play a crucial role in developing and maintaining our cutting-edge software platform and robotics interfaces.Required Skills:Expertise in full-stack development, with a strong...

  • Big Data Architect

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Data Architect

    2 weeks ago


    tamil nadu, India CES Full time

    CES has 26+ years of experience in delivering Software Product Development, Quality Engineering, and Digital Transformation Consulting Services to Global SMEs & Large Enterprises. CES has been delivering services to some of the leading Fortune 500 Companies including Automotive, AgTech, Bio Science, EdTech, FinTech, Manufacturing, Online Retailers, and...

  • Data Engineer

    4 days ago


    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Senior Data Engineer

    2 weeks ago


    Chennai,Tamil Nadu, India Resourcetree Full time

    Description : As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms. Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven...

  • Senior Data Engineer

    2 weeks ago


    Chennai/Tamil Nadu, Tamil Nadu, India Resourcetree Full time

    Description : As a Senior Data Engineer specializing in Cloud Analytics, you will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on cloud platforms.Leveraging your expertise in data engineering, cloud technologies, and analytics tools, you will play a key role in enabling data-driven decision-making...

  • Senior AI/ML Engineer

    2 weeks ago


    tamil nadu, India Pristine AI Full time

    PristineAIPristineAI is pioneering a ‘Self-Improving’ Retail enterprise solution platform. We are seeking highly motivated Solution/ML Engineers to join our teams in Mumbai and Chennai. As Solution/ML Engineer, you will leverage Software Engineering, LLM, Machine Learning, Oracle, and Azure to design, develop and implement solutions that will have a...


  • tamil nadu, India LTIMindtree Full time

    Job Title: LTIMindtree Hiring Snowflake ProfessionalsLocation: Mumbai/Pune/Chennai/Kolkata/ Coimbatore/Delhi/Hyderabad/BangaloreExperience: 5 to 17yrsSkills: Snowflake, Sql, ETLJob Description-Must have experience working as a snowflake, Data warehouse, ETL, BI projects.-Must have experience at least two end to end implementation of Snowflake cloud data...


  • tamil nadu, India TivonaGlobal Technologies Full time

    Tivona Global is looking for a Senior Data Engineer to work on Cloud Native Application development projects as a part of our development team based out of Chennai. The Senior Data Engineer will be responsible for developing APIs and cloud native applications including serverless applications using Python and various AWS cloud native/serverless services.Send...

  • Tableau Admin

    7 days ago


    tamil nadu, India Guardian Life Full time

    Competencies/Skills: Individual Contributor Competencies4-12 years of strong background in Tableau Platform 2019 & 2020 versions.Extensive experience in installation, administration, SSO configuration, migration, configuration, upgrades, technical support, troubleshooting, infrastructure maintenance, support, and overall health of the Tableau...

  • Data Lead

    2 weeks ago


    tamil nadu, India Hexaware Technologies Full time

    Job DescriptionCollibra Implementation Engineer (Data Governance & Data Quality)8+ years of experience in Data management, data quality and data governance and 2+ experience in implementation/Support of Collibra.Understand the implementation process flow of Collibra starting with Operating model to policies and rules.Working experience in Collibra’s...


  • tamil nadu, India Ciber Global Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...


  • tamil nadu, India Hitachi Energy Full time

    Hitachi Energy, High Voltage Products is implementing Digital solutions to improve efficiency and quality. These are cloud-based solutions that will be used by all manufacturing units within the business unit.Roles and Responsibilities:Strong experience on Microsoft SQL Server and developing T-SQL (Transact SQL) Stored Procedures, Functions and Triggers,...