Senior Data Engineer

3 weeks ago


tamil nadu, India Poshmark Full time
Job Description:
The Big Data team is a central player in the Poshmark organization. Our mission is to build a world-class big data platform to bring value out of data for us and for our customers. Our goal is to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.
The Data Engineering team at Poshmark is looking for an experienced software engineer to scale Datalake, ensuring real-time access to quality data for all the stakeholders. The role provides opportunity to showcase in-depth software development skills to build and maintain real-time and batch data pipelines with a focus on scalability and optimizations while collaborating with Data Science, Analytics, and Platform Engineering teams to build tools to access petabyte scale data.
Responsibilities
Build highly scalable, available, fault-tolerant data processing systems using AWS technologies, MapReduce, Hive, Kafka, Spark, Flink and other big data technologies to handle batch and real-time data processing over 10s of terabytes of data ingested every day and a petabyte-sized data warehouse.
Responsible for taking care of some of the most critical data pipelines at Poshmark.
Participate in architecture discussions, influence product roadmap, build best practices, take ownership and responsibility over new projects.
Create WBS (Work breakdown structure) for projects and execute them, taking full ownership, with minimal guidance.
Desired Skills & Experience
3+ years of relevant software engineering experience.
1+ year of Data Engineering experience.
Excellent technical problem solving using data structures and algorithms, with emphasis on optimization and code quality.
Expertise in architecting and building large-scale data processing systems using Big Data technologies like Hadoop, Hbase, Spark, Kafka, Druid, Flink, DataLake etc.
Eagerness to try out newer technologies and adopt them as and when needed.
Object Oriented Patterns, Scala / Java / Python / C++ / SQL / Apache Spark, Hadoop, AWS S3, Redshift / Postgresql, Kinesis, EMR, Apache Airflow, Jenkins.
We built Poshmark around four core values:
Focus on people to create empowered communities that drive success.
Together we grow to support each other to strive for our dreams.
Lead with love to foster genuine connections built upon a foundation of respect.
Embrace your weirdness to accept and empower one another on their own unique journey. We’re invested in our team and community, working together to build an entirely new way to shop. That way, when we win, we all win together. Come help us build the most connected shopping experience ever.
About Us
Poshmark is a leading fashion resale marketplace powered by a vibrant, highly engaged community of buyers and sellers and real-time social experiences. Designed to make online selling fun, more social and easier than ever, Poshmark empowers its sellers to turn their closet into a thriving business and share their style with the world. Since its founding in 2011, Poshmark has grown its community to over 130 million users and generated over $10 billion in GMV, helping sellers realize billions in earnings, delighting buyers with deals and one-of-a-kind items, and building a more sustainable future for fashion. For more information, please visit , and for company news, visit newsroom.poshmark.com .
Why Poshmark?
At Poshmark, we’re constantly challenging the status quo and are looking for innovative and passionate people to help shape the future of Poshmark. We’re disrupting the industry by combining social connections with e-commerce through data-driven solutions and the latest technology to optimize our platform. We’re nothing without our amazing team who deliver an unparalleled social shopping experience to the millions of people we connect each day.
We built Poshmark around four core values: 1) focus on people to create empowered communities that drive success; 2) together we grow to support each other to strive for our dreams; 3) lead with love to foster genuine connections built upon a foundation of respect; and 4) embrace your weirdness to accept and empower one another on their own unique journey. We’re invested in our team and community, working together to build an entirely new way to shop. That way, when we win, we all win together. Come help us build the most connected shopping experience ever. We will set you up with comprehensive global and in-country benefits to support you and your family needs.
Poshmark is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
View Poshmark's Job Applicant Privacy Policy here .

  • tamil nadu, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...


  • tamil nadu, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...


  • tamil nadu, India Sriven Full time

    Job Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data...


  • tamil nadu, India Sriven Full time

    Job Title: Senior Big Data EngineerExperience Required: 7+ yearsEducational Qualification: Bachelor's degree from an accredited college or universityJob Description:We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data pipelines...

  • Senior Engineer

    4 months ago


    tamil nadu, India Tiger Analytics Full time

    Role: Senior Engineer – Quality EngineeringWork Location – Chennai, Bangalore or HyderabadTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our 4000+ tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a...

  • Senior Data Engineer

    3 weeks ago


    tamil nadu, India Altimetrik Full time

    Primary Skill :Data EngineerSecondary Skill : GCP, Big QueryExp : 5 to 10 yrsJob Description:We are seeking a skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly in BigQuery and Pub/Sub, coupled with advanced proficiency in Python. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data...


  • tamil nadu, India Altimetrik Full time

    Primary Skill :Data Engineer Secondary Skill : GCP, Big Query Exp : 5 to 10 yrs Job Description: We are seeking a skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly in BigQuery and Pub/Sub, coupled with advanced proficiency in Python. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing...

  • Senior Data Engineer

    3 weeks ago


    tamil nadu, India Mastech InfoTrellis Full time

    Position: Azure Data Engineer Lead and DeveloperLocation : Chennai(Hybrid-3 days a week)/ If Non Local, need quarterly once, sit with team for a week or twoDuration: Full TimePositions: 7Notice Period: 15-40 days (Non- Negotiable)**Should have good Comms skills- Its client facing role**1st preference will be given to local candidatesCandidates from...


  • tamil nadu, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience. Experience Required: 7- 14 Year sLocation: Coimbatore, Tamil Nadu, Indi a Responsibiliti esDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data...

  • Data Architect

    4 days ago


    tamil nadu, India Wavicle Data Solutions Full time

    Multiple years of hands-on experience working as a data architect on Azure or AWS or Snowflake cloud ecosystems. Designing & implementing the organization's data architecture, including data models, data flows, and data storage solutions. Creating and maintaining data dictionaries and data maps to document data sources, data types, and data relationships....

  • Data Architect

    1 week ago


    Tamil Nadu, India Wavicle Data Solutions Full time

    Multiple years of hands-on experience working as a data architect on Azure or AWS or Snowflake cloud ecosystems. Designing & implementing the organization's data architecture, including data models, data flows, and data storage solutions.Creating and maintaining data dictionaries and data maps to document data sources, data types, and data...


  • tamil nadu, India Blackstraw Full time

    Data Engineer Company Name: Blackstraw.ai Office Location: Chennai (Work from Office) Job Type: Full-time Experience: 6+ Years Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall,...

  • Sr Data Engineer

    3 weeks ago


    tamil nadu, India Truelancer.com Full time

    Job Title: Sr Data EngineerExperience: 5 - 9 yrsLocation: Work from Office ,ChennaiMandatory Skills: AWS Data Services+Strong in SQL QueriesAs a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and analytics solutions. You will work with a range of AWS technologies and data tools to ensure our...

  • AWS Data Engineers

    3 weeks ago


    tamil nadu, India PTS Consulting Full time

    We are seeking Experienced AWS Data Engineers with extensive expertise in AWS (EMR/S3/GLUE/REDSHIFT etc) to join our Cloud practice delivering transformative solutions to leading clients.This is a GREEN FIELD Projec t and NOT A lift and Shift Project. We are seeking highly experienced individuals who have experience in a AWS Green field setting.At this...


  • tamil nadu, India Crayon Data Full time

    Role: MLops Engineer Experience level: 5-7years Location: Chennai (Hybrid) Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...

  • Engineering Manager

    3 days ago


    tamil nadu, India Crayon Data Full time

    Engineering Manager (10 to 12 yrs) Chennai, Tamil Nadu, India Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...


  • tamil nadu, India Crayon Data Full time

    Role: MLops EngineerExperience level: 5-7yearsLocation: Chennai (Hybrid)Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai, helps enterprises...


  • tamil nadu, India Intelliserve Konsulting Pvt Ltd Full time

    Organization Leading Insurance company (Client of Intelliserve)Role : Data Engineer ManagerLocation: ChennaiExperience 11+ YearsIndustry: General InsuranceWorking Mode Work from the officePurpose:This role will own the data ingestion, storage, and engineering processes and functions on the data platform. The Data Engineering Manager will ensure the timely...

  • Senior Data Analyst

    2 weeks ago


    tamil nadu, India Mastech InfoTrellis Full time

    Position: Senior Data AnalystLocation: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration: Full TimeCompany: Mastech InfoTrellis Senior Data Analyst will be responsible for performing data extraction, data gap analysis, mapping data to Azure-based data models, and ensuring data integrity and consistency across systems. This...


  • tamil nadu, India Value Health Inc Full time

    Role: Senior Gen AI EngineerJob Location: CoimbatoreJob Overview:We are seeking a highly skilled and experienced Senior Gen AI Engineer to join our dynamic team. The ideal candidate will have a strong background in machine learning, artificial intelligence, natural language processing & Generative AI with a proven track record of developing and deploying...