Big Data Platform Engineer

4 days ago

Thane, India Prodapt Full time

Roles and Responsibilities:

  • Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms.
  • Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc.
  • Grant access to BQ datasets, GCS buckets and Hive tables etc.
  • Work closely with Leads, architects, product owners and PMO’s to enable new use cases in cloud.
  • Administer Cloud platforms (BigQuery and DataProc) and manage reliability of platforms
  • Monitor health of Cloud platforms, proactively identify the issues and address them
  • Monitor the systems, Generate Performance Reports and provide continuous improvements.
  • Develop frameworks to automate platform administration and monitoring tasks.
  • Develop scripts to automate reports and maintenance activities.
  • Work with cross functional teams to set up production environment and enable solutions for business.
  • Debug day to day issues in cloud platforms and provide solutions.
  • Perform Tuning and increase Operational efficiency on a continuous basis.
  • Interact with business users to answer their queries and solve their problems.
  • Able to help and Guide L1 support engineers to fix day-to-day Operational issues.


Requirements:

  • Minimum 6+ years of work experience and 4-5 years of work experience in Big Data technologies.
  • Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
  • Experience in working Google cloud platform or other cloud platforms will be plus.
  • Good knowledge about Hadoop platform architecture, Hardware specs, Performance Benchmarking.
  • Require good Unix skills and good knowledge about Networking architecture, Datacenter issues etc.
  • Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
  • Should be proficient in writing shell scripts, automating the scripts and designing scheduler processes.
  • Should be able to understand Python/Scala/Java programs and debug the issues.
  • Excellent oral, written communication and presentation skills, analytical and problem-solving skills.
  • Self-driven, Ability to work independently and as part of a team.

  • Senior Data Engineer

    1 month ago

    Thane, India redBus Full time

    redBus.in is India's largest online bus ticketing platform operating across India, SEA & LATAM (Part of GO-MMT group, Nasdaq: MMYT). We have the largest network of bus operators and satisfied customers booking upto 250,000 transactions a day through mobile and desktop channels. With over 300,000+ live routes in multiple continents we host the largest...

  • Azure Data Engineer

    2 months ago

    thane, India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement data quality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory,...

  • Data Engineer

    3 weeks ago

    Thane, India Maestro Technologies, Inc. Full time

    Role Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines, ensuring data is easily accessible and actionable for business teams. You will work closely with data scientists, analysts, and other engineers to support data integration and transformation efforts, leveraging GCP services such as...

  • AVP, Data Engineering – SonyLIV

    1 month ago

    Thane, India Sony Pictures Networks India Full time

    Drive the Future of Data-Driven Entertainment Are you passionate about working with big data? Do you want to shape the direction of products that impact millions of users daily? If so, we want to connect with you. We’re seeking a leader for our Data Engineering team who will collaborate with Product Managers, Data Scientists, Software Engineers, and ML...

  • Data Engineer

    4 weeks ago

    Thane, India IntraEdge Full time

    We have an opening for Data Engineer role with a focus on building pipelines, data quality, governance, and transformation using the required tools:Job Title: Data Engineer (DBT & Snowflake specialist)Location: Pune or Remote (immediate Joining or 1 month)Job Type: Full-timeExp Level- 3 To 9 yearsData Engineering, building pipelines, SQL, Informatica Data...

  • Azure Data Architect

    1 week ago

    Thane, India LTIMindtree Full time

    Mode of Employment: Permanent / FTEWorkplace Type: HybridLocation: all LTIMindtree Location (Pune, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata, Noida)We are looking for a highly skilled Azure Data Architect with proven expertise in designing and implementing complex, high-performance data architectures. The candidate will actively engage with clients,...

  • Data Engineer

    3 months ago

    Thane, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as Data Engineer Role.Experience Required: 4+ years.Location: PAN IndiaResponsibilities:Databricks Development: Design, develop, and optimize Databricks workflows and solutions.Python & PySpark: Write, test, and maintain Python and PySpark code for data processing and analytics.SQL Proficiency:...

  • Maestro Technologies, Inc. | Data Engineer | thane

    3 weeks ago

    thane, India Maestro Technologies, Inc. Full time

    Role Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines, ensuring data is easily accessible and actionable for business teams. You will work closely with data scientists, analysts, and other engineers to support data integration and transformation efforts, leveraging GCP services such as...

  • Manager - Platform Engineering and Scalability

    4 months ago

    Thane, India Tata AIA Life Insurance Full time

    Job Description A Position Overview Position Title Assistant Vice President - Customer and Distribution Services Department TDABSG Level/ Band AVP Role Summary : We are looking for a React Native technical lead experienced in building performant mobile apps on both the iOS and Android platforms. You will be responsible for...

  • Ventura Securities

    4 months ago

    Thane, India Ventura Securities Ltd. Full time

    SALARY : 50LPA - 75LPAJob Description - Data Science LeadAbout us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable...

  • Data Science Trainer

    3 months ago

    Kopri, Thane, Maharashtra, India DPMI Institute Full time

    **Key Responsibilities**: - Develop and deliver data science course content (lectures, assignments, projects, etc.) for online and offline classes. - Teach essential data science concepts such as data wrangling, machine learning, statistical analysis, data visualization, and big data tools. - Guide students through practical projects, coding exercises, and...

  • Artificial Intelligence and Data Science Team Lead

    2 weeks ago

    Thane, India CircoLife Full time

    Position Title:Artificial Intelligence and Data Science Team LeadLocation: ThaneType: Full-timeExperience Level: SeniorAbout us:CircoLife is a climate tech start-up with a circular business model, offering highly energy-efficient & smart air conditioners on a 'Cooling-as-a-Service' or subscription model in India. Key features of the product and service model...

  • Software Engineer with Data Experience

    4 days ago

    Thane, India FrontM Full time

    Job Title: Software Engineer with data experienceAbout FrontM:FrontM is a dynamic maritime software company focused on improving connectivity and engagement for seafarers and maritime enterprises. Our flagship product, onship, is a superapp designed to offer collaboration, entertainment, and welfare solutions to the global maritime industry. By leveraging...

  • Artificial intelligence and data science team lead

    2 weeks ago

    Thane, India CircoLife Full time

    Position Title: Artificial Intelligence and Data Science Team LeadLocation : ThaneType : Full-timeExperience Level : SeniorAbout us:Circo Life is a climate tech start-up with a circular business model, offering highly energy-efficient & smart air conditioners on a 'Cooling-as-a-Service' or subscription model in India. Key features of the product and...

  • Artificial Intelligence and Data Science Team Lead

    2 weeks ago

    Thane, India CircoLife Full time

    Position Title: Artificial Intelligence and Data Science Team LeadLocation : ThaneType : Full-timeExperience Level : SeniorAbout us:CircoLife is a climate tech start-up with a circular business model, offering highly energy-efficient & smart air conditioners on a 'Cooling-as-a-Service' or subscription model in India. Key features of the product and...

  • Senior Software Engineer

    2 months ago

    thane, India System Soft Technologies Full time

    Senior Software Developer100% REMOTEJob Description Key skills needed (in priority order):4+ years of experience in MEAN stack development for production systems4+ years of experience in Functional Programming in Java Script (promises, await, async, etc.)4+ years of experience in backend node JS (node 12+)2+ years of experience with React (latest version...

  • Azure Data Engineer

    1 month ago

    Thane, India Hexaware Technologies Full time

    Experience: 6-9 yrs Work location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 days Senior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work...

  • Executive - Data Science

    6 months ago

    Thane, India Tata AIA Life Full time

    **Job Description **A Position Overview** **Position Title** Junios Data Engineer - Azure / JDE(A) **Department** IT **Level / Band** **Role Summary**: - Have excellent problem-solving and troubleshooting skills. This also includes the ability to search and find the optimal solutions for a Data Engineering problem. - Have an innovative mindset to...

  • Data Analytics Technical Manager

    5 days ago

    Thane, India Cloud4C Services Full time

    Job Title: Data Analytics Technical ManagerWork Location : Hyderabad Job SummaryThe Data Analytics Technical Manager is responsible for leading a team of data professionals in the development, deployment, and management of data analytics solutions on various public cloud platforms such as Azure, Google Cloud Platform (GCP), Oracle Cloud Infrastructure (OCI),...

  • Artificial Intelligence and Data Science Team Lead

    2 weeks ago

    Thane, India CircoLife Full time

    Position Title: Artificial Intelligence and Data Science Team Lead Location : Thane Type : Full-time Experience Level : Senior About us: CircoLife is a climate tech start-up with a circular business model, offering highly energy-efficient & smart air conditioners on a 'Cooling-as-a-Service' or subscription model in India. Key...