[All remote jobs](https://jobicy.com/jobs.md)[![NetBox Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/df239a55-221.png)](https://jobicy.com/company/netbox-labs.md)[NetBox Labs](https://jobicy.com/company/netbox-labs.md)

# Senior Software Engineer, Observability

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

[Apply for this job](#job-application)[View company](https://jobicy.com/company/netbox-labs.md)ShareRemote from[USA](https://jobicy.com/job-region/usa.md), [LATAM](https://jobicy.com/job-region/latam.md)SalaryUSD 85k–95k / yrDepartment[Software Engineering](https://jobicy.com/categories/engineering.md)EmploymentFull TimeExperienceSeniorPublished14 Oct 2026Apply before13 Nov 2026Listing views48Application actions4Application toolkit

## Make your next move.

Prepare your resume, explore your fit, and draft a cover letter for this opportunity.

AI Summary

## The role, at a glance.

NetBox Labs is hiring a senior software engineer for its Observability Team to build network discovery, reconciliation, monitoring, and fleet-management capabilities. The role centers on production Go services, protobuf-based APIs, PostgreSQL, Redis, RabbitMQ, and event-driven multi-tenant architectures. The engineer will apply observability practices using OpenTelemetry and work with networking concepts, cloud platform integrations, and open-source communities. Success requires ownership of technical design, careful use and review of coding-agent output, and close collaboration with product, platform, and community stakeholders.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

4/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

4/5IndependentCollaborative

AI insightThis is a senior-level distributed-systems role requiring deep Go expertise alongside networking, observability, security, messaging, and data-store experience. The engineer is expected to own correctness and technical decisions while producing clear specifications for cross-functional collaborators.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job median (per year)Below market$90,000US market range (per year)$145k–$190k0$209.00k

AI insightThe employer discloses a yearly base compensation range of $85,000–$95,000 USD, with a midpoint of $90,000. For a senior observability-focused software engineer in the US market, the estimated annual market range is $145,000–$190,000 USD; actual compensation may vary materially by approved remote region and total-rewards structure.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[Go](https://jobicy.com/jobs?search_keywords=Go.md)[OpenTelemetry](https://jobicy.com/jobs?search_keywords=OpenTelemetry.md)[gRPC](https://jobicy.com/jobs?search_keywords=gRPC.md)[Protocol Buffers](https://jobicy.com/jobs?search_keywords=Protocol%20Buffers.md)[PostgreSQL](https://jobicy.com/jobs?search_keywords=PostgreSQL.md)[Redis](https://jobicy.com/jobs?search_keywords=Redis.md)[RabbitMQ](https://jobicy.com/jobs?search_keywords=RabbitMQ.md)[Event-Driven Architecture](https://jobicy.com/jobs?search_keywords=Event-Driven%20Architecture.md)[OAuth 2.0](https://jobicy.com/jobs?search_keywords=OAuth%202.0.md)[OpenID Connect](https://jobicy.com/jobs?search_keywords=OpenID%20Connect.md)[Network Observability](https://jobicy.com/jobs?search_keywords=Network%20Observability.md)[Kubernetes](https://jobicy.com/jobs?search_keywords=Kubernetes.md)[Network Protocols](https://jobicy.com/jobs?search_keywords=Network%20Protocols.md)[Technical Specification Writing](https://jobicy.com/jobs?search_keywords=Technical%20Specification%20Writing.md)

Sample interview questionsHow would you design an at-least-once event consumer that avoids harmful duplicate processing?I would make processing idempotent by assigning a stable event identifier, recording completed operations in durable storage, and enforcing uniqueness or state-transition checks transactionally. I would acknowledge a message only after the durable operation succeeds, use retries with backoff, and include dead-letter handling and metrics for persistent failures.

What observability would you add to a Go service that processes network telemetry?

I would instrument request and message-processing paths with OpenTelemetry traces, structured logs correlated by trace and tenant identifiers, and metrics for throughput, latency, errors, queue depth, retry rate, and resource utilization. I would also define service-level objectives and alerts around user-impacting behavior rather than only infrastructure health.

How would you approach a protobuf API that must evolve without breaking existing clients?

I would follow protobuf compatibility rules: never reuse field numbers, reserve removed fields and names, favor additive changes, and maintain sensible defaults. I would version APIs deliberately when semantic changes are unavoidable, add contract tests, and document migration behavior for users and downstream services.

Describe how you would secure a multi-tenant service using OAuth2 and OIDC.

I would validate issuer, audience, signature, expiration, and authorization claims using trusted OIDC metadata and key rotation. Tenant identity would be derived from verified claims rather than client input, then enforced consistently in authorization middleware, database queries, cache keys, logs, and asynchronous messages.

How do you use coding agents while remaining accountable for production-quality code?

I provide bounded tasks, architectural constraints, security expectations, and test requirements, then treat generated code as a draft rather than an authority. I review the implementation for correctness, edge cases, dependency risks, and maintainability, run automated tests and static analysis, and verify behavior through targeted manual or integration testing.

Opportunity details

## About this role.

NetBox Labs is seeking a Software Engineer with 5+ years of experience to join our Observability Team. Observability is a key component of network automation, and critical to our company mission to make it easier to build and manage complex networks.

This team is responsible for Network Discovery & Reconciliation, Network Observability & Monitoring, and Agents & Fleet Management. The team delivers both closed and open source software and owns projects such as [Orb](https://github.com/orb-community/orb), [Diode](https://github.com/netboxlabs?q=diode) and [pktvisor](https://github.com/orb-community/pktvisor).

In this role you will bring:

*

Deep experience with idiomatic Go

*

Experience with protobuf APIs (gRPC and Connect RPC), PostgreSQL (including migrations), Redis, and RabbitMQ

*

Experience with multi-tenant services, OAuth2/OIDC, and event-driven systems, including at-least-once delivery and idempotent consumers

*

Deep knowledge of observability and instrumentation, including OpenTelemetry

*

A solid understanding of networking: devices, configuration, protocols, and layers

*

The ability to use coding agents day to day: set the constraints, review the output, and remain accountable for correctness, security, and tests

*

Great communication skills, including the ability to write technical specifications with diagrams

You will work closely with:

*

Product owners – to bring ideas to life and deliver a compelling user experience

*

The NetBox team – to create the ultimate observability tooling within NetBox

*

The platform team – to ensure seamless integration with NetBox Cloud and Enterprise

*

Community members as users and contributors to the project

It would be fantastic if you have the following experience:

*

3+ years of experience working in a fast paced startup environment

*

MQTT or other device/IoT protocols, or gNMI

*

Kubernetes in production

*

Django, NetBox, or NetBox plugins

*

Python for tests and tooling

### About NetBox Labs:

NetBox Labs helps companies build and manage complex networks. We help customers accelerate network automation by delivering open, composable products and supporting the network automation community.

NetBox Labs is the commercial steward of open source NetBox, the world’s most popular network source of truth, and Orb, the next-generation open source network observability platform. Our products include NetBox Enterprise, a fully supported self-managed NetBox with advanced features, and NetBox Cloud, a secure, scalable, and reliable SaaS edition of NetBox.

NetBox powers thousands of companies, and NetBox Labs is backed by investment from Notable Capital (formerly GGV), Grafana Labs CEO Raj Dutt, Flybridge, IBM, Salesforce Ventures, and Mango Capital.

### About NetBox Labs:

NetBox Labs helps companies build and manage complex networks. We help customers accelerate network automation by delivering open, composable products and supporting the network automation community.

NetBox Labs is the commercial steward of open source NetBox, the world’s most popular network source of truth, and Orb, the next-generation open source network observability platform. Our products include NetBox Enterprise, a fully supported self-managed NetBox with advanced features, and NetBox Cloud, a secure, scalable, and reliable SaaS edition of NetBox.

NetBox powers thousands of companies, and NetBox Labs is backed by investment from Notable Capital (formerly GGV), Grafana Labs CEO Raj Dutt, Flybridge, IBM, Salesforce Ventures, and Mango Capital.

### Our culture and values:

*

We own and solve problems with high attention to detail.

*

Our open source contributors, users, customers & team are all part of our community. When our community wins, we win.

*

We prioritize simplicity and think twice before adding complexity

*

Clear communication helps keep our team aligned and collaborating smoothly.

NetBox Labs is proud to be an equal opportunity employer. We believe diverse teams build better software, and we welcome applicants of every race, color, religion, gender identity, sexual orientation, national origin, age, disability, and veteran status. If you need accommodation at any point in the process, just let us know.

Show more

[Apply now >](https://jobicy.com/jobs/155325-senior-software-engineer-observability.md)

*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

*
![Flex logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/7bfdefe3-221.jpeg)
Flex Oct 14  New

### [Senior Staff Software Engineer, Partner Integrations](https://jobicy.com/jobs/155313-senior-staff-software-engineer-partner-integrations.md)

Flex is a growth-stage, NYC headquartered FinTech company that is creating the best rent payment experience. It’s hard to believe that it’s 2026 and paying rent on time is expensive,…

*
![RStudio logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/7c5f8854-221.jpg)
RStudio Oct 14  New

### [Senior Software Engineer](https://jobicy.com/jobs/155311-senior-software-engineer-14.md)

About the role Data science is in a moment of reinvention: AI-generated code and agentic workflows are changing what it means to put analytical work into production. Posit’s mission is…

*
![Fanatics logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/800c61bf-221.png)
Fanatics Oct 14  New

### [Senior Staff Engineer – Mobile/Kotlin](https://jobicy.com/jobs/155305-senior-staff-engineer-mobile-kotlin.md)

About Us Fanatics is building a leading global digital sports platform. We ignite the passions of global sports fans and maximize the presence and reach for our hundreds of sports…

*
![Fanatics logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/800c61bf-221.png)
Fanatics Oct 14  New

### [Senior Software Engineering Manager](https://jobicy.com/jobs/155302-senior-software-engineering-manager.md)

About Us Fanatics is building a leading global digital sports platform. We ignite the passions of global sports fans and maximize the presence and reach for our hundreds of sports…

*
![PointClickCare logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/02/94d5c7bae5858d7e126022ed422c639c.jpeg)
PointClickCare Oct 14  New

### [Ai Solution Engineer – (Technology Support)](https://jobicy.com/jobs/155288-ai-solution-engineer-technology-support.md)

At PointClickCare our mission is simple: to help providers deliver exceptional care. And that starts with our people. As a leading health tech company that’s founder-led and privately held, we…

*
![Grafana Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/11/42a3c42246467ec231dd876e92b63452.jpeg)
Grafana Labs Oct 14  New

### [Engineering Manager – Observability | UK | Remote](https://jobicy.com/jobs/155283-engineering-manager-observability-uk-remote.md)

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale….

*
![Grafana Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/11/42a3c42246467ec231dd876e92b63452.jpeg)
Grafana Labs Oct 14  New

### [Engineering Manager – Observability | Spain | Remote](https://jobicy.com/jobs/155277-engineering-manager-observability-spain-remote.md)

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale….

*
![Grafana Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/11/42a3c42246467ec231dd876e92b63452.jpeg)
Grafana Labs Oct 14  New

### [Engineering Manager – Observability | Sweden | Remote](https://jobicy.com/jobs/155280-engineering-manager-observability-sweden-remote.md)

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale….

*
![Deepgram logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/12/WRILS-201212160008-406229.jpg)
Deepgram Oct 14  New

### [Solutions Architect (EST or PST hours)](https://jobicy.com/jobs/155256-solutions-architect-est-or-pst-hours.md)

Company Overview Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More…

*
![MaintainX logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/f0177662-221.png)
MaintainX Oct 14  New

### [Software Developer, Mobile Platform](https://jobicy.com/jobs/155262-software-developer-mobile-platform.md)

MaintainX is a leading mobile-first work execution platform for industrial and frontline teams. More than 13,000 customers, including Duracell, McDonald’s, Shell, DHL and Volvo, use MaintainX to cut unplanned downtime…

[Browse all jobs](https://jobicy.com/jobs.md)