正在加载内容...

963963 Chat Hub Portal Independent coverage of news

Understanding News Fundamentals 5: Costs, Limits and Trade-offs

By James Whitfield · · 1307 words
Understanding News Fundamentals 5: Costs, Limits and Trade-offs

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for load balancing. For load balancing, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on load balancing usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

Consent is ongoing. A person can withdraw it at any point, including after previously agreeing or after an activity has begun. If they say stop, move away, become unresponsive or otherwise indicate discomfort, pause immediately and ask what they want. Do not argue, bargain or demand an explanation.

If the rollback plan needs a meeting, it is not a rollback plan. The same reasoning holds for backup strategy. For backup strategy, the constraint matters more than the feature list. Small pages that stay small are easier to keep fast than large ones made fast. Teams working on backup strategy usually discover this the hard way. Write the invariant down; otherwise it lives only in someone's memory.

Configurations should be reviewable in a diff, not only in a console. This is most visible in access control. Consider access control specifically. The best time to add an index is before the table gets large. Access Control: Failures are usually correlated, so plan for the shared dependency.

Search Indexing: Configurations should be reviewable in a diff, not only in a console. Search Indexing: The best time to add an index is before the table gets large. Search Indexing: Failures are usually correlated, so plan for the shared dependency.

API Design: Serving static bytes is the cheapest thing you can do at the edge. API Design: A schema is an interface; changing it is a migration, not an edit. API Design: Track the denominator as carefully as the numerator.

Consider schema markup specifically. You can often replace a coordination problem with an idempotency key. Schema Markup: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. That applies to schema markup as well.

Content Delivery: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. That applies to content delivery as well. In practice, content delivery behaves differently: Costs usually concentrate in a small number of operations, so find those first.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for cloud infrastructure. For cloud infrastructure, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on cloud infrastructure usually discover this the hard way. Track the denominator as carefully as the numerator.

Consider data pipelines specifically. You can often replace a coordination problem with an idempotency key. Data Pipelines: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. That applies to data pipelines as well.

API Design: If the rollback plan needs a meeting, it is not a rollback plan. API Design: Small pages that stay small are easier to keep fast than large ones made fast. API Design: Write the invariant down; otherwise it lives only in someone's memory.

Log Analysis: If the rollback plan needs a meeting, it is not a rollback plan. Log Analysis: Small pages that stay small are easier to keep fast than large ones made fast. Log Analysis: Write the invariant down; otherwise it lives only in someone's memory.

Product contents can also affect how an order travels. Some powered products contain rechargeable lithium batteries, and carriers or routes may have rules for their transport. Restrictions can affect available shipping methods, delivery time or whether a particular destination is served. Confirm the product’s power details and the seller’s shipping notes rather than assuming every delivery option is available. For any product, use the seller’s stated delivery estimate as an estimate, not a guarantee, and check whether the selected service requires a signature or leaves parcels in a shared lobby.

Crawl Budget: The first thing to settle is the failure mode, not the happy path. Crawl Budget: Measurements taken once are anecdotes; you need a baseline that repeats. Crawl Budget: Costs usually concentrate in a small number of operations, so find those first.

For load balancing, the constraint matters more than the feature list. The first thing to settle is the failure mode, not the happy path. Teams working on load balancing usually discover this the hard way. Measurements taken once are anecdotes; you need a baseline that repeats. Costs usually concentrate in a small number of operations, so find those first. This is most visible in load balancing.

For edge caching, the constraint matters more than the feature list. Periodic jobs should be safe to run twice, because they will be. Teams working on edge caching usually discover this the hard way. You rarely need a new component to fix a boundary problem. The signal you want is often already logged, just not aggregated. This is most visible in edge caching.

Consider crawl budget specifically. Serving static bytes is the cheapest thing you can do at the edge. Crawl Budget: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. That applies to crawl budget as well.

Data Pipelines: A design that cannot be rolled back is a design that cannot be changed safely. Data Pipelines: Latency budgets are easier to defend when every hop has a stated ceiling. Data Pipelines: Caching helps only until the invalidation rules become the bottleneck.

For data pipelines, the constraint matters more than the feature list. If a metric has no owner, it will drift until it causes an incident. Teams working on data pipelines usually discover this the hard way. The cheapest optimisation is usually removing work nobody asked for. Aggregating at write time trades flexibility for predictable read cost. This is most visible in data pipelines.

You can often replace a coordination problem with an idempotency key. The same reasoning holds for log analysis. For log analysis, the constraint matters more than the feature list. Anything that grows without a bound will eventually hit one. Teams working on log analysis usually discover this the hard way. Documentation that is not tested tends to describe the previous version.

Monitoring Alerts: Configurations should be reviewable in a diff, not only in a console. Monitoring Alerts: The best time to add an index is before the table gets large. Monitoring Alerts: Failures are usually correlated, so plan for the shared dependency.

Choose a cool, dry storage location away from direct sunlight, heaters, bathrooms with frequent steam and sharp objects. Do not leave the product in a vehicle or another place exposed to large temperature changes. Keep it out of reach of children and pets. A sealed container can help keep dust away, but only pack the product when both it and the container are dry; trapped moisture can remain on surfaces and in seams.

Consider observability specifically. The interesting number is not the average, it is the 99th percentile. Observability: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to observability as well.

Consider schema migration specifically. A design that cannot be rolled back is a design that cannot be changed safely. Schema Migration: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to schema migration as well.

Related reading