Senior Big Data Solutions Architect Position

This role is for an experienced Big Data Architect to lead multiple data engagements on cloud platforms.

The ideal candidate will have more than 8 years of experience in technical roles, with a strong background in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied structured and unstructured data sources and targets.

• Lead big data engagements on cloud platforms for data lakes, data engineering, data migration, data warehouse, and business intelligence.
• Interface with stakeholders within IT and business to understand the data requirements.
• Take complete responsibility for the successful delivery of all allocated projects on schedule, quality, and customer satisfaction parameters.
• Design and develop distributed, high volume multi-thread batch, real-time, and event processing systems.
• Implement processes and systems to validate data, monitor data quality, ensuring production data is accurate and available for key stakeholders and business processes that depend on it.
• Work with the pre-sales team on RFPs and RFIs, helping them create data solutions.
• Mentor young talent within the team, define, and track their growth parameters.
• Contribute to building assets and accelerators.

Requirements:

• More than 8 years of experience in technical roles.
• 5+ years of experience in building and managing data lakes, data warehouse, data integration, data migration, and business intelligence/solutions on cloud platforms.
• Ability to understand business requirements, translate them into functional and non-functional areas, define non-functional boundaries in terms of availability, scalability, performance, security, resilience, etc.
• Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied structured and unstructured data sources and targets.
• Experience of having worked in distributed computing and enterprise environments like Hadoop, cloud platforms.
• Well-versed with various data integration, and ETL technologies on cloud like Spark, PySpark/Scala, Dataflow, DataProc, EMR, etc. on various cloud platforms.
• Experience of having worked with traditional ETL tools like Informatica/DataStage/OWB/Talend, etc.
• Deep knowledge of one or more cloud and on-premise databases like Cloud SQL, Cloud Spanner, Big Table, RDS, Aurora, DynamoDB, Oracle, Teradata, MySQL, DB2, SQL Server, etc.
• Exposure to any of the No-SQL databases like MongoDB, CouchDB, Cassandra, Graph dB, etc.
• Experience in architecting and designing scalable data warehouse solutions on cloud on Big Query or Redshift.
• Experience in having worked on one or more data integration, storage, and data pipeline toolsets like S3, Cloud Storage, Athena, Glue, Sqoop, Flume, Hive, Kafka, Pub-Sub, Kinesis, Dataflow, DataProc, Airflow, Composer, Spark SQL, Presto, EMRFS, etc.
• Preferred experience of having worked on machine learning frameworks like TensorFlow, PyTorch, etc.
• Good understanding of cloud solutions for IaaS, PaaS, SaaS, containers, and microservices architecture and design.
• Ability to compare products and tools across technology stacks on Google, AWS, and Azure cloud.
• Good understanding of BI reporting and dashboarding and one or more toolsets associated with it like Looker, Tableau, Power BI, SAP BO, Cognos, Superset, etc.
• Understanding of security features and policies in one or more cloud environments like GCP/AWS/Azure.
• Experience of having worked in business transformation projects for movement of on-premise data solutions to clouds like GCP/AWS/Azure.

Other Skills:

• Strong communication and articulation skills.
• Good leadership skills.
• Should be a good team player.
• Good analytical and problem-solving skills.