Data.Text.Internal

Copyright	(c) 2008 2009 Tom Harper (c) 2009 2010 Bryan O'Sullivan (c) 2009 Duncan Coutts
License	BSD-style
Maintainer	bos@serpentine.com
Stability	experimental
Portability	GHC
Safe Haskell	Safe-Inferred
Language	Haskell2010

Description

A module containing private Text internals. This exposes the Text representation and low level construction functions. Modules which extend the Text system may need to use this module.

You should not use this module unless you are determined to monkey with the internals, as the functions here do just about nothing to preserve data invariants. You have been warned!

Types

Internally, the Text type is represented as an array of Word8 UTF-8 code units. The offset and length fields in the constructor are in these units, not units of Char.

Invariants that all functions must maintain:

Since the Text type uses UTF-8 internally, it cannot represent characters in the reserved surrogate code point range U+D800 to U+DFFF. To maintain this invariant, the safe function maps Char values in this range to the replacement character (U+FFFD, '�').
Offset and length must point to a valid UTF-8 sequence of bytes. Violation of this may cause memory access violation and divergence.

data Text Source

A space efficient, packed, unboxed Unicode text type.

Constructors

Text !Array !Int !Int

Instances

Instances details

Data Text Source	This instance preserves data abstraction at the cost of inefficiency. We omit reflection services for the sake of data abstraction. This instance was created by copying the updated behavior of `Data.Set.Set` and `Data.Map.Map`. If you feel a mistake has been made, please feel free to submit improvements. The original discussion is archived here: could we get a Data instance for Data.Text.Text? The followup discussion that changed the behavior of `Set` and `Map` is archived here: Proposal: Allow gunfold for Data.Map, ...
Instance details Defined in Data.Text Methods gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Text -> c Text Source gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c Text Source toConstr :: Text -> Constr Source dataTypeOf :: Text -> DataType Source dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c Text) Source dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c Text) Source gmapT :: (forall b. Data b => b -> b) -> Text -> Text Source gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Text -> r Source gmapQr :: forall r r'. (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Text -> r Source gmapQ :: (forall d. Data d => d -> u) -> Text -> [u] Source gmapQi :: Int -> (forall d. Data d => d -> u) -> Text -> u Source gmapM :: Monad m => (forall d. Data d => d -> m d) -> Text -> m Text Source gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Text -> m Text Source gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Text -> m Text Source
IsString Text Source	Performs replacement on invalid scalar values: `>>> :set -XOverloadedStrings >>> "\55555" :: Text "\65533"`
Instance details Defined in Data.Text Methods fromString :: String -> Text Source
Monoid Text Source
Instance details Defined in Data.Text Methods mempty :: Text Source mappend :: Text -> Text -> Text Source mconcat :: [Text] -> Text Source
Semigroup Text Source	Since: text-1.2.2.0
Instance details Defined in Data.Text Methods (<>) :: Text -> Text -> Text Source sconcat :: NonEmpty Text -> Text Source stimes :: Integral b => b -> Text -> Text Source
IsList Text Source	Performs replacement on invalid scalar values: `>>> :set -XOverloadedLists >>> ['\55555'] :: Text "\65533"` Since: text-1.2.0.0
Instance details Defined in Data.Text Associated Types type Item Text Source Methods fromList :: [Item Text] -> Text Source fromListN :: Int -> [Item Text] -> Text Source toList :: Text -> [Item Text] Source
Read Text Source
Instance details Defined in Data.Text Methods readsPrec :: Int -> ReadS Text Source readList :: ReadS [Text] Source readPrec :: ReadPrec Text Source readListPrec :: ReadPrec [Text] Source
Show Text Source
Instance details Defined in Data.Text.Show Methods showsPrec :: Int -> Text -> ShowS Source show :: Text -> String Source showList :: [Text] -> ShowS Source
PrintfArg Text Source	Since: text-1.2.2.0
Instance details Defined in Data.Text Methods formatArg :: Text -> FieldFormatter Source parseFormat :: Text -> ModifierParser Source
Binary Text Source	Since: text-1.2.1.0
Instance details Defined in Data.Text Methods put :: Text -> Put Source get :: Get Text Source putList :: [Text] -> Put Source
NFData Text Source
Instance details Defined in Data.Text Methods rnf :: Text -> () Source
Eq Text Source
Instance details Defined in Data.Text Methods (==) :: Text -> Text -> Bool Source (/=) :: Text -> Text -> Bool Source
Ord Text Source
Instance details Defined in Data.Text Methods compare :: Text -> Text -> Ordering Source (<) :: Text -> Text -> Bool Source (<=) :: Text -> Text -> Bool Source (>) :: Text -> Text -> Bool Source (>=) :: Text -> Text -> Bool Source max :: Text -> Text -> Text Source min :: Text -> Text -> Text Source
Lift Text Source	Since: text-1.2.4.0
Instance details Defined in Data.Text Methods lift :: Quote m => Text -> m Exp Source liftTyped :: forall (m :: Type -> Type). Quote m => Text -> Code m Text Source
type Item Text Source
Instance details Defined in Data.Text type Item Text = Char

Construction

text Source

Arguments

:: Array	bytearray encoded as UTF-8
-> Int	offset in bytes (not in Char!), pointing to a start of UTF-8 sequence
-> Int	length in bytes (not in Char!), pointing to an end of UTF-8 sequence
-> Text

Construct a Text without invisibly pinning its byte array in memory if its length has dwindled to zero.

textP :: Array -> Int -> Int -> Text Source

Deprecated: Use text instead

Safety

safe :: Char -> Char Source

Map a Char to a Text-safe value.

Unicode Surrogate code points are not included in the set of Unicode scalar values, but are unfortunately admitted as valid Char values by Haskell. They cannot be represented in a Text. This function remaps those code points to the Unicode replacement character (U+FFFD, '�'), and leaves other code points unchanged.