All remote jobs

Senior Software Engineer, Observability

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

Remote from
USA, LATAM
Salary
USD 85k–95k / yr
Employment
Full Time
Experience
Senior
Published
Apply before
13 Nov 2026
Listing views
34
Application actions
3
Application toolkit

Make your next move.

Prepare your resume, explore your fit, and draft a cover letter for this opportunity.

AI Summary

The role, at a glance.

NetBox Labs is hiring a senior software engineer for its Observability Team to build network discovery, reconciliation, monitoring, and fleet-management capabilities. The role centers on production Go services, protobuf-based APIs, PostgreSQL, Redis, RabbitMQ, and event-driven multi-tenant architectures. The engineer will apply observability practices using OpenTelemetry and work with networking concepts, cloud platform integrations, and open-source communities. Success requires ownership of technical design, careful use and review of coding-agent output, and close collaboration with product, platform, and community stakeholders.

Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

Job Complexity

5/5
EasyHard

Pace & Pressure

4/5
RelaxedFast-paced

Autonomy Level

5/5
GuidedFull ownership

Communication Load

4/5
IndependentCollaborative
AI insightThis is a senior-level distributed-systems role requiring deep Go expertise alongside networking, observability, security, messaging, and data-store experience. The engineer is expected to own correctness and technical decisions while producing clear specifications for cross-functional collaborators.

Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job median (per year)Below market
$90,000
US market range (per year)$145k–$190k
AI insightThe employer discloses a yearly base compensation range of $85,000–$95,000 USD, with a midpoint of $90,000. For a senior observability-focused software engineer in the US market, the estimated annual market range is $145,000–$190,000 USD; actual compensation may vary materially by approved remote region and total-rewards structure.

Core skills

Skills and capabilities most closely associated with this opportunity.

Sample interview questions
How would you design an at-least-once event consumer that avoids harmful duplicate processing?

I would make processing idempotent by assigning a stable event identifier, recording completed operations in durable storage, and enforcing uniqueness or state-transition checks transactionally. I would acknowledge a message only after the durable operation succeeds, use retries with backoff, and include dead-letter handling and metrics for persistent failures.

What observability would you add to a Go service that processes network telemetry?

I would instrument request and message-processing paths with OpenTelemetry traces, structured logs correlated by trace and tenant identifiers, and metrics for throughput, latency, errors, queue depth, retry rate, and resource utilization. I would also define service-level objectives and alerts around user-impacting behavior rather than only infrastructure health.

How would you approach a protobuf API that must evolve without breaking existing clients?

I would follow protobuf compatibility rules: never reuse field numbers, reserve removed fields and names, favor additive changes, and maintain sensible defaults. I would version APIs deliberately when semantic changes are unavoidable, add contract tests, and document migration behavior for users and downstream services.

Describe how you would secure a multi-tenant service using OAuth2 and OIDC.

I would validate issuer, audience, signature, expiration, and authorization claims using trusted OIDC metadata and key rotation. Tenant identity would be derived from verified claims rather than client input, then enforced consistently in authorization middleware, database queries, cache keys, logs, and asynchronous messages.

How do you use coding agents while remaining accountable for production-quality code?

I provide bounded tasks, architectural constraints, security expectations, and test requirements, then treat generated code as a draft rather than an authority. I review the implementation for correctness, edge cases, dependency risks, and maintainability, run automated tests and static analysis, and verify behavior through targeted manual or integration testing.

This analysis is generated from the job description. Salary estimates, role characteristics and sample answers are guidance, not employer-provided facts.
Opportunity details

About this role.

NetBox Labs is seeking a Software Engineer with 5+ years of experience to join our Observability Team. Observability is a key component of network automation, and critical to our company mission to make it easier to build and manage complex networks.

This team is responsible for Network Discovery & Reconciliation, Network Observability & Monitoring, and Agents & Fleet Management. The team delivers both closed and open source software and owns projects such as Orb, Diode and pktvisor.

In this role you will bring:

  • Deep experience with idiomatic Go

  • Experience with protobuf APIs (gRPC and Connect RPC), PostgreSQL (including migrations), Redis, and RabbitMQ

  • Experience with multi-tenant services, OAuth2/OIDC, and event-driven systems, including at-least-once delivery and idempotent consumers

  • Deep knowledge of observability and instrumentation, including OpenTelemetry

  • A solid understanding of networking: devices, configuration, protocols, and layers

  • The ability to use coding agents day to day: set the constraints, review the output, and remain accountable for correctness, security, and tests

  • Great communication skills, including the ability to write technical specifications with diagrams

You will work closely with:

  • Product owners – to bring ideas to life and deliver a compelling user experience

  • The NetBox team – to create the ultimate observability tooling within NetBox

  • The platform team – to ensure seamless integration with NetBox Cloud and Enterprise

  • Community members as users and contributors to the project

It would be fantastic if you have the following experience:

  • 3+ years of experience working in a fast paced startup environment

  • MQTT or other device/IoT protocols, or gNMI

  • Kubernetes in production

  • Django, NetBox, or NetBox plugins

  • Python for tests and tooling

About NetBox Labs:

NetBox Labs helps companies build and manage complex networks. We help customers accelerate network automation by delivering open, composable products and supporting the network automation community.

NetBox Labs is the commercial steward of open source NetBox, the world’s most popular network source of truth, and Orb, the next-generation open source network observability platform. Our products include NetBox Enterprise, a fully supported self-managed NetBox with advanced features, and NetBox Cloud, a secure, scalable, and reliable SaaS edition of NetBox.

NetBox powers thousands of companies, and NetBox Labs is backed by investment from Notable Capital (formerly GGV), Grafana Labs CEO Raj Dutt, Flybridge, IBM, Salesforce Ventures, and Mango Capital.

About NetBox Labs:

NetBox Labs helps companies build and manage complex networks. We help customers accelerate network automation by delivering open, composable products and supporting the network automation community.

NetBox Labs is the commercial steward of open source NetBox, the world’s most popular network source of truth, and Orb, the next-generation open source network observability platform. Our products include NetBox Enterprise, a fully supported self-managed NetBox with advanced features, and NetBox Cloud, a secure, scalable, and reliable SaaS edition of NetBox.

NetBox powers thousands of companies, and NetBox Labs is backed by investment from Notable Capital (formerly GGV), Grafana Labs CEO Raj Dutt, Flybridge, IBM, Salesforce Ventures, and Mango Capital.

Our culture and values:

  • We own and solve problems with high attention to detail.

  • Our open source contributors, users, customers & team are all part of our community. When our community wins, we win.

  • We prioritize simplicity and think twice before adding complexity

  • Clear communication helps keep our team aligned and collaborating smoothly.

NetBox Labs is proud to be an equal opportunity employer. We believe diverse teams build better software, and we welcome applicants of every race, color, religion, gender identity, sexual orientation, national origin, age, disability, and veteran status. If you need accommodation at any point in the process, just let us know.

Apply now >

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Did you apply?Let us know, and we’ll help you track your application.

Continue on the employer website

Protect your personal information and never pay to secure an interview or job offer. .

Log in to save
One quick step before you apply

Sign in to continue.

Sign in or create a free account to continue to the employer's application.

Applying is free. After signing in, return to this job and select Apply Now.
Add alert
Jobs Talent AI Tools Salaries
Menu