Senior Big Data Engineer

4 weeks ago

Dindigul, India People Prime Worldwide Full time

About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Title: Senior Data EngineerLocation: Hyderabad,ChennaiExperience: 6 - 12 yearsEmployment Type: PermanentNotice Period: Immediate JoinersKey Responsibilities:Big Data Processing:Design, develop, and maintain scalable ETL/ELT pipelines using PySpark, Scala, or Java.Implement data transformation workflows to ensure clean and reliable datasets.Cloud Integration:Work extensively with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS to build and manage data solutions.Data Modeling & Optimization:Develop and optimize data models in Hadoop and Spark environments.Ensure performance tuning and cost optimization of cloud-based data platforms.Data Ingestion & Integration:Ingest data from various sources including APIs, RDBMS, and NoSQL databases.Implement data pipelines for batch and real-time processing.Collaboration & Documentation:Collaborate with cross-functional teams to understand data requirements and deliver solutions.Document data models, transformation logic, and technical specifications.Automation & Monitoring:Automate data workflows and ensure data pipelines are reliable, scalable, and error-free.Implement data monitoring, logging, and alerting to ensure pipeline reliability.Required Skills & Qualifications:Technical Expertise:6–12 years of experience in Big Data engineering with strong hands-on experience in AWS, PySpark, Scala, or Java.Proficiency in SQL and experience with Hadoop ecosystem components like Hive, HDFS, and Kafka.Cloud Services:Extensive experience with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS.Data Engineering Tools:Familiarity with data orchestration tools like Apache Airflow or Oozie.Experience with containerization technologies like Docker and Kubernetes is a plus.Soft Skills:Strong analytical and problem-solving skills.Excellent communication and collaboration abilities.Ability to work independently and in a team-oriented environment.Preferred Skills (Good to Have):Certifications: AWS Certified Solutions Architect, AWS Certified Big Data – Specialty, or Cloudera Certified Associate (CCA).Experience with CI/CD pipelines using tools like Jenkins or GitLab.Knowledge of data warehousing concepts and experience with platforms like Redshift or Snowflake.Familiarity with streaming technologies such as Apache Kafka or Kinesis.

  • Senior DevOps Engineer

    4 days ago

    Dindigul, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Big Data Senior Developer Jobs Opening in A Client of Freshersworld at DindigulLess

    7 days ago

    Dindigul, India A Client of Freshersworld Full time

    Big Data Senior DeveloperJOB DESCRIPTIONUnderstand non-functional requirements and the ability to turn them into Functional/Technical requirements. Then apply the architectural principles to leverage the Spark Framework to reproduce specific use cases and/or features inputs for models.Passion towards automation where appropriate and beneficialUnderstand Data...

  • Senior Snowflake Data Engineer

    4 days ago

    Dindigul, India iVoyant Full time

    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.Key Responsibilities:We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering and Snowflake development.Expert in Snowflake native features: Snow pipe, Streams, Tasks, Time Travel, Zero-Copy Cloning, and Secure Data...

  • Senior Data Integration Engineer

    4 weeks ago

    Dindigul, India Indsafri Full time

    Job Title - Senior Data Integration EngineerExperience - 6+YearsJob SummaryWe are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intelligence ecosystem. In this critical role, you will be the subject matter expert responsible for designing and implementing...

  • Data engineer

    4 weeks ago

    Dindigul, India IGT Solutions Full time

    Job Title: Data EngineerExperience: 2-3 yearsLocation: RemoteInterested candidate please share resume on Kalyani. Responsibilities:Design, develop, and maintain scalable data pipelines using Python and Py Spark.Work with SQL and Mongo DB to manage and query large datasets.Develop and implement solutions using Snowflake for data warehousing.Leverage AWS...

  • Principal

    2 weeks ago

    Dindigul, India SENIOR SECONDARY CBSE SCHOOL DINDIGUL Full time

    **WANTED PRINCIPAL** **Senior Secondary School ( CBSE), Dindigul, Tamilnadu** - Requires minimum 4 years of teaching and 4 years as a Vice Principal / Principal. - Age Preferred is around 40-50Yrs. - Tamil Speaking is essential. **Job duties include but not limited to**: - Lead a big academic and administrative team - Develops institutional goals and...

  • Data Engineer

    4 weeks ago

    Dindigul, India Aptologics Full time

    Company Description Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that help enterprises move faster, decide smarter, and grow with confidence. Role Description We are looking for an experienced Data Engineer to join...

  • Senior quality assurance automation engineer

    5 days ago

    Dindigul, India Sourcebae Full time

    Job Alert: Senior Automation Test Engineer (4-7 Yrs) in Jaipur ???? Are you a seasoned Automation Engineer with a passion for quality and robust backend testing? Join our dynamic team at PSI (Pratham Software) and drive automation excellence! We are looking for a Senior Automation Test Engineer with 4-9 years of experience to lead the design and...

  • Senior Metocean Engineer

    3 weeks ago

    Dindigul, India ISIR AI Full time

    🌊 We’re Hiring – Senior Metocean Engineer / Coastal Modeler | ISIR.AIISIR.AI is expanding its Marine & Coastal Division and is looking for a highly experienced Senior Metocean Engineer / Coastal Modeler to join our dynamic and growing team.We are seeking professionals with strong expertise in hydrodynamic modeling, metocean data analysis, and...

  • Azure Data Engineer

    2 days ago

    Dindigul, India techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Job Title: Azure Data EngineerLocation:...