About the Role You will help develop the future of our Hadoop/Hive & Trino query engines, expand into our in-house developed storage solution, and maintain technical excellence addressing challenging problems. You will work with a distributed team across Japan, Korea, and Canada and contribute to the roadmap with your team.ResponsibilitiesDesign and develop Hadoop/Hive & Trino solutions, providing technical expertise for modern data architecture assessment and use case developmentEstablish engineering standards for design, development, tuning, deployment, and maintenance of advanced data access frameworks and distributed systemsCollaborate with your team to define product roadmaps based on operational needs and customer-requested features while mentoring and training new team membersOwn version and release management, including baseline evaluation, patch backporting, and deployment of customer-facing featuresCoordinate with Support and Product teams on release cycles and feature deliveryContribute to Hadoop/Hive & Trino OSS through bug fixes, new features, and technical documentationPartner with SRE to automate cluster operations, reducing operational overhead through automated lifecycle management and load balancing workflowsDesign and implement observability solutions, including health metrics, capacity planning tools, and automated failure detection and recovery systemsProvide expert customer support, including on-call responsibilities, escalation handling, and in-depth troubleshooting of performance and defect issuesDevelop custom technical solutions, including user-defined functions (UDFs) and specialized tooling for Hadoop/Hive & TrinoRequirements5+ years building and operating distributed systemsStrong Java and deep understanding of algorithms, data structures, and distributed systems fundamentalsSolid understanding of cloud architecture and services in public clouds like AWS, GCP, or Microsoft AzureStrong capability in implementing new and improved data solutions for multi-tenant environmentsExperience in developing use cases, functional specs, design specs, etc.Experience working with distributed, scalable Big Data stores or NoSQL, including HDFS, S3, Cassandra, Big Table, etc.Strong analytical and communication skills; able to influence across Product, SRE, and SupportNice to HaveUnderstanding of the capabilities of Hadoop/Hive or TrinoProven experience operating production query engines on a petabyte scaleMicroservices architecture, data integration patterns, and extending OSSInfra-as-Code, SRE practices, and advanced observabilityUDF development and familiarity with data visualization ecosystemsSecurity and privacy-by-design expertiseExperience with storage patterns and optimizations for massive parallel processingPhysical Requirements Working out of our Vancouver, BC office according to our “Global Hybrid Working Policy.”Travel Requirements Travel typically 5% of the year, including one week in Japan annually, another in Mountain View, CA, and possibly an additional week elsewhere.Perks and BenefitsCompetitive compensation packagesRestricted Stock Units (RSU)Paid vacation and sick timePaid volunteer and mental health daysUp to 26 weeks paid parental leave including a post-partum night nurse16 Company holidays (includes 2 floating holidays)RRSP with 6% company matchEmployer provided Supplemental medical, dental, disability & life coverageComprehensive support and access to care for everyone, everywhere through Carrot - our global reproductive health and family-building benefit#J-18808-Ljbffr
Senior Software Engineer - Query Engines & Storage
TREASURE AI
vancouver, vancouver
Published TodayNew
Report job