Remove duplicate lines, sort and clean up text

Options you can set

• Strip HTML tags
• Remove punctuation
• Collapse repeated spaces
• Trim each line
• Remove empty lines
• Remove duplicate lines
• Ignore case when finding duplicates
• Sort lines
• Remove all line breaks

Good to know

• Steps run in a fixed order: strip HTML, remove punctuation, collapse spaces, trim, remove empty lines, remove duplicates, sort, then join lines.
• Sorting compares letters without regard to case and isn't language-specific. Natural order sorts numbers by value (file2 before file10).
• HTML stripping is meant for tidying copied text, not for making untrusted HTML safe.
• Windows line endings are kept as they were.

Text Cleaner FAQ

More developer & text tools in Toolfox

• JSON Formatter Format, minify and validate JSON, with exact error locations.
• CSV ↔ JSON Convert CSV to JSON and JSON to CSV, with clear rules for headers, types and nesting.
• Base64 Encoder / Decoder Encode text or files as Base64, or decode Base64 back to text or a file.
• Hash Generator Calculate SHA-256 and other checksums for text or files, and compare against an expected value.
• QR Code Generator Create QR codes for links, text, Wi-Fi networks and contacts. Export as PNG or SVG.
• Text Diff Compare two texts or text files and see added, removed and changed lines.
• Password Generator Generate strong random passwords or memorable passphrases, with an honest strength estimate. Created on this computer and never stored.
• UUID Generator Generate UUIDs (v4 random, v7 time-ordered), ULIDs and NanoIDs, or inspect pasted IDs for their version and timestamp.
• Lorem Ipsum Generator Generate placeholder text as paragraphs, sentences or words, in plain text or HTML.
• Barcode Generator Create Code 128, EAN-13, EAN-8, UPC-A, Code 39 and ITF barcodes, with check digits computed and validated. Export as PNG or SVG.
• QR Code Reader Read QR codes from photos and screenshots, including links, Wi-Fi details and contact cards.
• Word Counter Count words, characters, sentences and paragraphs, estimate reading time and find the most used keywords.
• Case Converter Change text to UPPERCASE, lowercase, Title Case, Sentence case, camelCase, snake_case and other cases.
• Find & Replace Find and replace text, using plain text or regular expressions with group references.
• Regex Tester Test a regular expression against text and see every match with its position and captured groups.
• URL, HTML & Binary Encoder Encode or decode URLs, HTML entities, binary, hex and Unicode escapes.
• URL Parser Break a URL into scheme, host, port, path, query parameters and fragment, with everything decoded.
• JWT Decoder Decode a JSON Web Token to read its header, payload and expiry, and optionally check an HMAC signature.
• Timestamp Converter Convert Unix timestamps to dates and dates to Unix time, in UTC and your local time zone.
• Color Converter Convert colors between HEX, RGB, HSL, HSV and CMYK, find the nearest CSS name and check WCAG contrast.
• Number Base Converter Convert whole numbers of any size between binary, octal, decimal, hexadecimal and any base from 2 to 36.
• Markdown to HTML Convert Markdown to HTML, as a fragment or a complete styled page, or turn HTML back into Markdown.
• SQL & XML Formatter Format or minify SQL and XML, and check that XML is well-formed.
• JSON, YAML & XML Converter Convert data between JSON, YAML, TOML and XML, with the input format detected automatically.

See all 57 tools →