Shanraq.org Shanraq.org
How sound and motion become data
Society

Informatics: build your own digital assistant Lesson 15 of 72

How sound and motion become data

Understand how a microphone measures sound over time and how video shows a sequence of frames.

Where we are on the map

A voice sounds continuous, yet a file contains a finite list of values. How do we turn a smooth wave into numbers, and what might be lost?

How sound and motion become data

Everyday analogy and exact model

If you record a river’s water level once an hour, the table shows separate measurements, not every change between them. Digitizing sound works similarly: the changing signal is measured many times each second. Video represents motion with a sequence of separate images.

An audio sample is a numerical measurement of the signal at one moment. Sample rate tells how many samples per second are taken for each channel. In a toy example at 4 samples/s, one second has sample times 0, 0.25, 0.5, 0.75 s: exactly four, not five. At 8000 samples/s, one channel, and 8 bits per sample, one second of raw data uses 8000 bytes. Video stores frames at a stated rate and normally carries sound separately.

Wave, samples, and frames

A sound wave is changing air pressure over time. A sample is one measured value at one moment; the sampling rate counts such measurements per second. If samples are too sparse, fast changes can be missed. Amplitude is the size of a deviation; it relates to loudness but is not identical to perceived volume. A frame is one image in a video sequence; frame rate counts frames per second. Audio and video therefore store different sequences that the player synchronises in time.

Draw a wave passing through 0, 1, 0, −1, 0 over one second. Mark measurements at 0, 0.25, 0.5, 0.75, and 1 seconds: you get five numbers. Measure only at 0, 0.5, and 1: all readings are zero, and the motion vanishes from this recording. This is a teaching example of sampling too sparsely, not a claim that every real recording at that rate is silent. For video, draw four frames with a moving dot; reorder them and explain how the motion changes.

The assistant does not need voice input yet. In its passport, state which problem voice would solve and what new data would have to be stored. Do not enable a microphone just because the phone has one.

Where the analogy ends

A river table is not the river. The original wave between samples is not directly recorded; a reconstruction approximates it. Four samples/s is only a teaching diagram, not a rate for good speech. Headers and compression change actual file size.

The lesson’s support signal

time → sample → number; rate × duration × bits/sample × channels → raw bits

Worked example

Use four measurements 2, 5, 3, 0 at 0, 0.25, 0.5, 0.75 s. Draw four points in the right order. A two-second clip at 4 samples/s with one channel has eight numbers.

Predict before observing

How many raw bytes are in one second of mono audio at 8000 samples/s and 8 bits per sample? Write 8000 × 8 = 64000 bits, then divide by eight: 8000 bytes.

Do not jump straight to the answer. Write your prediction and its reason first. Compare each intermediate step as well as the final result. If you were right by chance, repeat with different values.

Reconstruct without a hint

Hide the worked example and calculate two seconds under the same conditions. Explain why doubling the number of channels doubles raw data if everything else stays fixed.

Cover the worked example with paper. Reconstruct the chain from the short support signal, explain every transition aloud, and then reveal the example to check yourself. If stuck, look back at only the preceding step.

Find and correct the mistake

“At 4 samples/s the points at 0, 0.25, 0.5, 0.75, and 1 s give five samples in the first second.” Explain the half-open interval [0,1): 1 s starts the next second.

Transfer to a new situation

A toy video has 2 frames/s. Name six frame times over three seconds: 0, 0.5, 1, 1.5, 2, 2.5 s. Sound does not turn into frames simply because it accompanies video.

Project change

Add to the assistant specification: if it later has a voice prompt, its format must say the sample rate, channel count, and sample representation. For now, store task text only; audio is unnecessary.

Exercise

Draw two timelines: four sound samples per second and two video frames per second. Label the times and compare counts without confusing sound with images.

Submit evidence that can be checked, rather than saying “I understood”: a table, calculation, file, or precise answer with a reason. Use fictional data. Ask another learner to repeat the action from your description; if they must guess, clarify the rule.

Return after 1, 7, and 30 days

Tomorrow recall all four sample times. In a week count mono samples over 2 s at 8000/s. In a month explain what the original signal between measurements does not directly preserve.

Next lesson: Why ZIP and a messenger compress differently

If you have found a mistake or a typo in this article, tell us about it

Check your project evidence

Enter your observation, explanation, error correction, and project change. The model will identify the first confused or unsupported link without giving you a finished answer.

Sign in to have it checked. Sign in

Comments (0)

No comments yet. Be the first.