Prodapt | Big Data Platform Engineer

1 month ago


india Prodapt Full time

Roles and Responsibilities:

  • Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms.
  • Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc.
  • Grant access to BQ datasets, GCS buckets and Hive tables etc.
  • Work closely with Leads, architects, product owners and PMO’s to enable new use cases in cloud.
  • Administer Cloud platforms (BigQuery and DataProc) and manage reliability of platforms
  • Monitor health of Cloud platforms, proactively identify the issues and address them
  • Monitor the systems, Generate Performance Reports and provide continuous improvements.
  • Develop frameworks to automate platform administration and monitoring tasks.
  • Develop scripts to automate reports and maintenance activities.
  • Work with cross functional teams to set up production environment and enable solutions for business.
  • Debug day to day issues in cloud platforms and provide solutions.
  • Perform Tuning and increase Operational efficiency on a continuous basis.
  • Interact with business users to answer their queries and solve their problems.
  • Able to help and Guide L1 support engineers to fix day-to-day Operational issues.


Requirements:

  • Minimum 6+ years of work experience and 4-5 years of work experience in Big Data technologies.
  • Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
  • Experience in working Google cloud platform or other cloud platforms will be plus.
  • Good knowledge about Hadoop platform architecture, Hardware specs, Performance Benchmarking.
  • Require good Unix skills and good knowledge about Networking architecture, Datacenter issues etc.
  • Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
  • Should be proficient in writing shell scripts, automating the scripts and designing scheduler processes.
  • Should be able to understand Python/Scala/Java programs and debug the issues.
  • Excellent oral, written communication and presentation skills, analytical and problem-solving skills.
  • Self-driven, Ability to work independently and as part of a team.



  • india Prodapt Full time

    Roles and Responsibilities: Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms. Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc. Grant access to BQ datasets, GCS buckets and Hive tables...


  • India Prodapt Full time

    Cloud Data Engineer at ProdaptAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms such as Google Cloud.You will work closely with cross-functional teams to develop and implement data...


  • india Prodapt Full time

    Responsibilities:In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch.Experience with popular Python frameworks such as Django, Flask or Pyramid.Knowledge of data science and machine learning concepts and tools.A working understanding of...


  • india Prodapt Full time

    Responsibilities: In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch. Experience with popular Python frameworks such as Django, Flask or Pyramid. Knowledge of data science and machine learning concepts and tools. A working understanding...


  • India ITI Data Full time

    Job Title: Big Data Solutions Architect Company Overview:ITI Data is a leading provider of data solutions and services. About the Role:We are seeking an experienced Big Data Solutions Architect to join our team. The successful candidate will have a strong background in designing and implementing large-scale data architectures using Apache Spark, Hadoop, and...


  • India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • india Prodapt Full time

    Roles and ResponsibilitiesData Collection: Collating and cleaning data from various entities for use by junior data scientistsData Analysis: Selecting and employing advanced statistical procedures to obtain actionable insight, cross-validating models to ensure generalizability, and suggesting ways to inform business strategies.Technical Research: Keeping...


  • India Iridium Cloud Systems Pvt Ltd Full time

    Join Iridium Cloud Systems and Revolutionize the Internet Iridium Cloud Systems subsidiary of cdmon.com, your go-to hosting, domain, and DNS company. Our mission is straightforward yet ambitious: To create an open and quality Internet where anyone can be. We're proud to craft our own architecture and services, ensuring unparalleled satisfaction for our...


  • India Syntasa Full time

    About Syntasa">Syntasa is a leading provider of software development and support services. Its subsidiary in India, Syntasa Technologies India Private Limited, serves as an extension of its US operations.">Job Overview">The company seeks a highly skilled Software Engineer - Big Data to lead the development of its big data platform.">Key...

  • Platform engineer

    18 hours ago


    India Syntasa Full time

    Platform Engineer – Big Data   Job Description   Syntasa is searching for high caliber, dedicated, and proven Software Engineer – Big Data in its newly created subsidiary in India called Syntasa Technologies India Private Limited. Five years ago, Syntasa formed Syntasa UK Limited to serve its European customers; now, India operations expand...

  • Big Data Innovator

    2 weeks ago


    India Luxoft Full time

    About the RoleWe are seeking a highly skilled Big Data Developer to join our team at Luxoft. As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies.The challenge will be to create high-performance...

  • Platform Engineer

    3 days ago


    India Syntasa Full time

    Platform Engineer – Big Data   Job Description   Syntasa is searching for high caliber, dedicated, and proven Software Engineer – Big Data in its newly created subsidiary in India called Syntasa Technologies India Private Limited. Five years ago, Syntasa formed Syntasa UK Limited to serve its European customers; now, India operations expand...

  • Platform Engineer

    4 days ago


    India Syntasa Full time

    Platform Engineer – Big Data Job Description Syntasa is searching for high caliber, dedicated, and proven Software Engineer – Big Data in its newly created subsidiary in India called Syntasa Technologies India Private Limited. Five years ago, Syntasa formed Syntasa UK Limited to serve its European customers; now, India operations expand Syntasa’s...

  • Platform Engineer

    3 days ago


    India Syntasa Full time

    Platform Engineer – Big Data   Job Description   Syntasa is searching for high caliber, dedicated, and proven Software Engineer – Big Data in its newly created subsidiary in India called Syntasa Technologies India Private Limited. Five years ago, Syntasa formed Syntasa UK Limited to serve its European customers; now, India operations expand...

  • Platform engineer

    1 month ago


    India Syntasa Full time

    latform Engineer – Big Data   Job Description   Syntasa is searching for high caliber, dedicated, and proven Software Engineer – Big Data in its newly created subsidiary in India called Syntasa Technologies India Private Limited. Five years ago, Syntasa formed Syntasa UK Limited to serve its European customers; now, India operations expand...


  • India Iridium Cloud Systems Pvt Ltd Full time

    Join Iridium Cloud Systems and Revolutionize the Internet Iridium Cloud Systems subsidiary of cdmon.com, your go-to hosting, domain, and DNS company. Our mission is straightforward yet ambitious: To create an open and quality Internet where anyone can be. We're proud to craft our own architecture and services, ensuring unparalleled satisfaction for our...


  • India NEXUS CONSULTING SOLUTIONS Full time

    Nexus Consulting Solutions seeks an experienced Big Data Systems Engineer to join our team. This is a challenging and rewarding role that requires expertise in designing, developing, and maintaining large-scale big data systems.We are looking for someone with hands-on experience in Python and Scala programming languages. Familiarity with the Spark framework,...


  • India Iridium Cloud Systems Pvt Ltd Full time

    Join Iridium Cloud Systems and Revolutionize the InternetIridium Cloud Systems subsidiary of cdmon.com, your go-to hosting, domain, and DNS company. Our mission is straightforward yet ambitious: To create an open and quality Internet where anyone can be. We're proud to craft our own architecture and services, ensuring unparalleled satisfaction for our...


  • India Iridium Cloud Systems Pvt Ltd Full time

    Join Iridium Cloud Systems and Revolutionize the Internet Iridium Cloud Systems subsidiary of cdmon.com, your go-to hosting, domain, and DNS company. Our mission is straightforward yet ambitious: To create an open and quality Internet where anyone can be. We're proud to craft our own architecture and services, ensuring unparalleled satisfaction for our...