Data Engineer for Cloud Data Processing

1 week ago


Rajkot, Gujarat, India Mastech InfoTrellis Full time

Mastech InfoTrellis Job Description:

Job Title: Data Engineer for Cloud Data Processing

Job Summary: We are seeking a highly skilled Data Engineer to join our team at Mastech InfoTrellis. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (GCP) using PySpark for data processing and analysis.

Key Responsibilities:

  • Design, develop, and maintain data pipelines on GCP using PySpark for data processing, transformation, and analysis.
  • Work closely with cross-functional teams to understand data requirements and translate them into technical solutions.
  • Optimize and tune data pipelines for performance, scalability, and reliability.
  • Implement best practices for data governance, security, and compliance.
  • Collaborate with Data Scientists and Analysts to support their data needs and ensure data availability and quality.
  • Troubleshoot and debug data pipeline issues in production environments.
  • Stay up-to-date with the latest trends and technologies in data engineering and cloud computing.
  • Contribute to the continuous improvement of our data engineering practices and processes.

Required Skills:

  • Proven experience as a Data Engineer familiar with Databricks and GCP services.
  • Strong proficiency in Google Cloud Platform (GCP) services, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Strong experience designing, implementing, and optimizing data pipelines using Databricks in GCP.
  • Hands-on experience with PySpark for data processing and analysis.
  • Solid understanding of distributed computing principles and experience with large-scale data processing frameworks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data modelling, ETL, and data warehousing concepts.
  • Excellent problem-solving and communication skills.
  • Ability to work effectively in a fast-paced, dynamic environment.

Preferred Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science & Engineering, or a related field.
  • Google Cloud Platform (GCP) certification.
  • Experience with other big data technologies such as Hadoop, Spark, or Apache Beam.
  • Knowledge of machine learning concepts and tools.
  • Experience with containerization technologies like Docker and Kubernetes.

  • GCP Data Professional

    3 weeks ago


    Rajkot, Gujarat, India Tekgence Inc Full time

    Our company, Tekgence Inc, is seeking a talented GCP Data Professional to join our team. This role involves designing and implementing scalable data solutions on Google Cloud Platform (GCP) using BigQuery, SQL Scripting, and Python coding.Key responsibilities include:Developing and maintaining large-scale data processing pipelines on GCP BigQuery.Writing...


  • Rajkot, Gujarat, India GFL Recruitment Private Limited Full time

    Job Title: Chief Data Engineering SpecialistAbout the Role:We are seeking an experienced Chief Data Engineering Specialist to join our team at GFL Recruitment Private Limited. As a key member of our organization, you will play a crucial role in shaping our data engineering strategy and implementing cutting-edge solutions.Responsibilities:Design and implement...


  • Rajkot, Gujarat, India ARPIFY Enterprise Solution Full time

    Job Title: Storage and Backup EngineerThe ARPIFY Enterprise Solution is seeking a skilled Storage and Backup Engineer to manage and support our data storage and backup infrastructure. This role involves overseeing storage systems, backup solutions, and ensuring data integrity, availability, and security.Key Responsibilities:Administer and maintain storage...


  • Rajkot, Gujarat, India Saama Full time

    Job Title: Epic Clarity Data EngineerLocation: NationwideExperience Level: 6-8 YearsJob Description:Saama Technologies is seeking a skilled Epic Clarity Data Engineer to join our team. The ideal candidate will have strong experience working with healthcare data, particularly in the Epic Clarity database, and expertise in building data pipelines and...


  • Rajkot, Gujarat, India Rajoo Engineers Limited Full time

    **Job Title:** Software Engineer in Python with Focus on Data Analysis and Visualization. **Job Description:** As a software engineer in Python with a focus on data analysis and visualization, you will be responsible for designing, developing, and deploying data-driven applications that meet the needs of our clients. You will work closely with...

  • Senior Data Analyst

    16 hours ago


    Rajkot, Gujarat, India Matalia Stock Broking Pvt. Ltd Full time

    Job OverviewMatalia Stock Broking Pvt. Ltd is a leading diversified stock broking company providing a broad range of financial products and services.Estimated Salary: ₹800,000 - ₹1,200,000 per annumJob DescriptionWe are seeking a skilled Python Developer to join our team in Rajkot. As a Python Developer, you will be responsible for:Understanding the data...


  • Rajkot, Gujarat, India FallenAmbers Full time

    Job OverviewFallenAmbers is seeking an experienced Human Resources Data Analyst to join our team in Rajkot, India.The successful candidate will have a strong background in database administration and human resources management software, with excellent analytical and reporting skills.ResponsibilitiesProcess employee data, including leaves and benefits, to...


  • Rajkot, Gujarat, India EVERSANA Full time

    About the RoleWe are seeking a highly skilled Data Quality Services Framework Developer to join our team at EVERSANA. As a key member of our Quality Assurance team, you will be responsible for guiding and influencing the development of a formal Data Quality Services Framework and supporting the development of software quality assurance test strategies.Key...


  • Rajkot, Gujarat, India Intechive Systems Full time

    Job Title: Peoplesoft Technical ConsultantsAt Intechive Systems, we are seeking talented Peoplesoft Technical Consultants with expertise in Oracle Analytics Cloud and Oracle Data Visualization to design, develop, and implement advanced data visualization and reporting solutions.Key Responsibilities:Collaborate with cross-functional teams to transform...

  • Software Engineer

    3 weeks ago


    Rajkot, Gujarat, India IDFC FIRST Bank Full time

    We are seeking a highly skilled Software Engineer to join our team and contribute to the development of cloud-based solutions. The ideal candidate will have experience with cloud computing platforms and languages like Java and Python. Key responsibilities include designing and implementing scalable cloud-based systems, collaborating with cross-functional...


  • Rajkot, Gujarat, India Urban FT Full time

    OverviewUrban FT is building a cutting-edge digital banking platform, and we need an experienced Principal Cloud Engineer to lead the development of high-performance applications. Our ideal candidate will have a strong background in designing, developing, and maintaining scalable cloud-native systems using AWS, Python, and Django.


  • Rajkot, Gujarat, India Delphic (South Asia) Full time

    Job Title: Senior Software Architect for Cloud Native ApplicationsDescription:We are seeking a seasoned software architect with expertise in cloud native applications to join our dynamic development team at Delphic (South Asia). The ideal candidate will have a proven track record of designing and implementing scalable, secure, and efficient cloud-based...


  • Rajkot, Gujarat, India Searce Technologies Inc Full time

    About the RoleAt Searce Technologies Inc, we're seeking a skilled Cloud Infrastructure Specialist to join our team of talented engineers. As a Cloud Infrastructure Specialist, you will be responsible for designing, implementing, and managing large-scale cloud deployments using modern configuration and deployment management systems.Key ResponsibilitiesDesign...

  • **Data Analyst**

    3 weeks ago


    Rajkot, Gujarat, India FallenAmbers Full time

    About the RoleWe are seeking a skilled Data Analyst to join our team. As a Data Analyst, you will play a key role in helping us make informed business decisions through data-driven insights.Key ResponsibilitiesCollect and analyze data from various sourcesDevelop and maintain databases and data systemsIdentify trends and patterns in dataProvide insights and...


  • Rajkot, Gujarat, India Societe Generale Global Solution Centre Full time

    Cloud Security SpecialistAt Societe Generale Global Solution Centre, we seek a skilled Cybersecurity Services Manager to join our team. As a Cloud Security Operations Lead, you will play a key role in ensuring the security and compliance of our cloud infrastructure.Validate Security Exceptions: Review and validate security exceptions raised by cloud and...


  • Rajkot, Gujarat, India FallenAmbers Full time

    **About the Role:**We are seeking a highly skilled Cloud Infrastructure Specialist to join our software development team.The successful candidate will be responsible for designing and implementing scalable cloud infrastructure solutions using cloud computing platforms.**Key Responsibilities:Design and implement cloud infrastructure architectureDevelop and...


  • Rajkot, Gujarat, India Lycos Ceramic Full time

    Job Summary:We are seeking a talented Cloud Architect to join our team at {company}.This role will involve designing and implementing scalable cloud-based systems, ensuring high availability and security.Key Responsibilities:Design and implement cloud-based architecturesDevelop and maintain cloud-based systemsCollaborate with cross-functional...


  • Rajkot, Gujarat, India Hirefaast Full time

    **Job Title: Senior DevOps Engineer**We are seeking a seasoned DevOps Engineer to join our team at Hirefaast. **Key Responsibilities:**Design and implement scalable cloud infrastructure on AWS.Develop and maintain Terraform scripts for infrastructure deployment.Ensure high availability and security of applications using Kubernetes and AWS EKS.Collaborate...


  • Rajkot, Gujarat, India Hirefaast Full time

    Hirefaast Job DescriptionJob Title: Sr. Devops EngineerYears of experience: 7+yrsLocation: Not specifiedJob Description: We are seeking a seasoned DevOps expert with 7+ years of experience to join our team at Hirefaast.Key Responsibilities:Design and implement scalable cloud infrastructure on AWSDevelop and manage Terraform scripts for infrastructure...


  • Rajkot, Gujarat, India SARDA PLYWOOD INDUSTRIES LTD Full time

    Job OverviewSarda Plywood Industries LTD seeks a skilled Finishing Incharge to oversee the finishing process of our plywood products. As the Finishing Incharge, you will be responsible for ensuring adherence to operational and quality policies and procedures to manage finishing work efficiently and safely.Key ResponsibilitiesOperational ManagementEnsure...