My (1024) neighbours are nicer than yours :)

In this post I show you a few (sort of) neighbours of « yellow ». I compare the neighbourhood of the word vectors obtained from LSI (or more precisely my fast variant of LSI) and using my method « NC-ISC ». The original cooccurrence matrix has been obtained from a merge of Europarl corpus and the BNC. No preprocessing have been applied to the corpus, not even lowercasing.

The vocabulary size is about 520000, the matrix has been transformed with positive pointwise mutual information.

The cooccurrence relation is simply « the next word ». Other relations could be used (including classical word windows), but I have chosen to show you this relation because it seems to be the most basic possible.

To sum up, the 520000*520000 cooccurrence matrix containing about 25M entries has been transformed into a 192 features-words dictionary.

Here are the (long, sorry) lists obtained

  • on the left, using my method (NC-ISC)
  • on the right, using the equivalent of a simple LSI (i.e. a thin SVD)

Things are getting a bit weird with LSI from the 100th row, approximately. On the other hands, NC-ISC keeps listing colors, aspects (visual then physical), for quite a long time. I’m not a native English speaker, so if you want to list the « acceptable » neighbours from the bad ones, you’re welcome !

NC-ISC ISC (LSI)
1 yellow yellow
2 red red
3 pink pink
4 blue blue
5 green purple
6 purple green
7 brown orange
8 white white
9 crimson brown
10 scarlet scarlet
11 coloured crimson
12 grey coloured
13 black grey
14 orange black
15 mauve golden
16 turquoise rainbow
17 shiny violet
18 golden saffron
19 lilac mauve
20 thick maroon
21 russet Pink
22 waxy bright
23 dyed pale
24 yellowish multicoloured
25 stained buff
26 greyish reddish
27 tawny peach
28 beige auburn
29 fluffy russet
30 magenta rosy
31 violet whitish
32 burgundy candy
33 striped emerald
34 faded waxy
35 maroon gold
36 amber fluorescent
37 emerald pearly
38 pale brownish
39 mottled gaudy
40 indigo dark
41 brownish cream
42 silky lilac
43 reddish ochre
44 peach amber
45 pearly darker
46 translucent Coloured
47 bright neon
48 trimmed silver
49 greenish Red
50 pinkish turquoise
51 silvery dun
52 wore tawny
53 patterned pearl
54 buff creamy
55 auburn flickering
56 scuffed striped
57 saffron incandescent
58 ochre pastel
59 rainbow Purple
60 shining spotted
61 satin magenta
62 gaudy apricot
63 dun gray
64 silken hyacinth
65 gold pinkish
66 flecked beige
67 bluish rufous
68 tattered faded
69 velvet sprouting
70 shaggy trailing
71 pleated grease
72 thin khaki
73 wearing White
74 whitish sooty
75 khaki lavender
76 dark peacock
77 beaded fawn
78 candy filigree
79 wears agarose
80 greasy sepia
81 downy ruby
82 woven Yellow
83 tulip colour
84 purplish burgundy
85 glistening sticky
86 silver Modotti
87 luminous deglamorised
88 soft Alesis
89 multicoloured starry
90 floppy luminous
91 veined flaming
92 iridescent chestnut
93 loose Silk
94 burnished fading
95 creamy ruddy
96 pastel silvery
97 embroidered ginger
98 hyacinth yellowish
99 crumpled zebra
100 lacy silk
101 edged eye
102 wear pencil
103 worn Blue
104 peacock Solenodon
105 silk Huntershill
106 thinning 3450
107 matching tinsel
108 lustrous iridescent
109 billowing Black
110 Pale silken
111 shades navy
112 tousled Vingoleuse
113 flowered Treve
114 frayed Airway
115 gloss plum
116 plaited reggaeish
117 lavender ignorers
118 gleaming ×30
119 navy lotus
120 tinted taffeta
121 oily pleated
122 fawn iris
123 rosy patterned
124 tinsel Smoltine
125 sported Informatics
126 necked Glengowan
127 Thick NUMEROSO
128 streaked Hedgecock
129 tan Chiropodist
130 ruby rust
131 speckled colouring
132 wavy indelible
133 brimmed TPS
134 waxed Scadplus
135 livid PORC
136 stripe AVERAGES
137 feathery indigo
138 fondant variegated
139 baggy spots
140 waterproof Nikši
141 spiky Funshineland
142 glossy Fencot
143 dusky lime
144 frothy tired…
145 bloodstained Hopgood
146 curly Claredon
147 swathed musk
148 trailing Bright
149 bushy beaded
150 taffeta purplish
151 brocade immunostaining
152 glowing Chalwyn
153 spattered 6U
154 pearl lemon
155 wispy youcallems
156 rufous Uists
157 fleshy slipcase
158 gray 350bhp
159 tinged toffee
160 chunky brighter
161 darker rayon
162 grubby glowing
163 smudged matt
164 toning Whiggism
165 frilly Savas
166 garish Bogakovsky
167 donned Pale
168 creased singlehandedly
169 quilted SHU
170 dripping cigarettes…
171 bleached Sherland
172 cream Shantytown
173 mulberry Ribman
174 wet embroidered
175 fluorescent Najaar
176 leathery fez
177 matt DELIMITING
178 sticky peaches
179 whiter halogen
180 ragged Leaves
181 shapeless Springvale
182 chestnut FFr37
183 cotton 37344
184 coarse Sponge
185 jewelled LCpl
186 dainty 95b
187 woolly shaped
188 shaped Saffron
189 enamelled ites
190 encrusted INTELLIGENTSIA
191 lace Southleaze
192 cropped peneplanation
193 leather kickers
194 soaked Sautoy
195 velvety Hardyman
196 ribbed Batcave
197 greying brayes
198 rumpled olive
199 plaid Milou
200 oatmeal FLICKERED
201 curling Dorada
202 sleeveless Jegsy
203 straw Grenside
204 frilled Conversative
205 collared Paraty
206 delicate Gartnavel
207 starched 12
208 oiled WENBAN
209 feather hobbyhorse
210 torn comest
211 damp lapis
212 smeared flame
213 flowery wheelback
214 gorgeous trunkal
215 buttoned Galatsaray
216 crepe BLIND
217 crinkled fiery
218 sleeved bluish
219 inky Nayakkar
220 knitted Yidjaru
221 spiked videotelephony
222 chequered Skerneside
223 sooty Woodall
224 paler RIOTING
225 tartan Focker
226 plain Assaf
227 enveloping Progressional
228 folds Chapmans
229 beading Brochwel
230 dappled satin
231 woollen uncleanly
232 clean Lemonhead
233 Wearing BOWN
234 matted paler
235 soiled oily
236 fringed Grey
237 underparts Vaches
238 tatty stridently
239 towelling Alternation
240 crisp Æthelingadene
241 reds whiter
242 ivory Jechan
243 denim harakiri
244 streaks Dominelli
245 blouses whol
246 pinks theistic
247 suede Channelling
248 milky Turania
249 necklaces OESD
250 heavy Gorbal
251 floral Manningtree
252 olive Huskison
253 beneath Ambrumenil
254 coats Sciskalsi
255 nylon methylguanine
256 shimmering governmentally
257 protective WOODARD
258 powdered patchiness
259 voluminous llah
260 hooded foliage
261 linen Yant
262 tweed CLIT
263 furry 9Sinclair
264 apricot Flint…
265 yellowing doubleheader
266 unbuttoned 4252
267 chipped quartz
268 thicker mulberry
269 feathered Lingerie
270 painted Cessnock
271 rubber 24X
272 opaque blond
273 soled showjumps
274 stiff colors
275 tufted Chencellor
276 flimsy downy
277 sodden Krankoor
278 ruddy HUH
279 belted Boehmer
280 wool modest…
281 bulbous Learner
282 tiny KATAHDIN
283 blond Caterall
284 ruffled Thoroughbred
285 chiffon Jangpura
286 threadbare cathexes
287 gauze Areca
288 polyester currant
289 dense dappled
290 muslin blackcurrant
291 drape POPULARITY
292 patchwork MAXCompress
293 padded Biz
294 scented dabbed
295 oversized unislamic
296 shirts insensiblement
297 ripped 40dB
298 Coloured uncultivatable
299 lightweight tonner
300 banded Tianawa
301 wax Photoionization
302 thickest hatchways
303 damask erth
304 scorched pumpkin
305 balaclava shining
306 dresses ovule
307 flashing COMMENTARIES
308 parchment Chegwin
309 gloves scented
310 wrinkled Weidhaas
311 corduroy Thornycroft
312 flecks Gulbot
313 scaly tunny
314 braided MAVRA
315 Thin 2844186
316 camouflage regularised
317 festooned Phonoctonus
318 length Mr Dmitri Rogozin
319 dusty Leskov
320 fur RELEVANCY
321 jersey RDP
322 wrapped 172ff
323 tangled interclonal
324 crochet horsehair
325 sleek FRAK
326 cardigan brushy
327 socks Pole…
328 straggly fundraisers
329 swirling 2872
330 jade rainbows
331 flaming wisps
332 rust laryngitis
333 patched Hyett
334 sepia BYRD
335 trousers xerophilous
336 sapphire Voxes
337 mourning Anrep
338 coated Hromada
339 fuzzy Heterosexism
340 dirty Atharva
341 pinned Dewell
342 flared BF397
343 fluted 42m
344 mandarin feather
345 gowns Shakeshaft
346 pubic DUNROSSIL
347 washable carless
348 peeling lacy
349 washed HCF
350 smooth Brenbachhof
351 breasted Axioms
352 tight Sarasvati
353 icing Macilwain
354 eggshell Arent
355 primrose TSh22
356 peaked Plus’
357 outsize Lackham
358 piece bloom
359 draped quantititative
360 cashmere Luczak
361 textured
362 plucked Leucadia
363 moss finmarchicus
364 stripes Campanella
365 glinting Spp
366 patches Rustenburg
367 wiped 601222
368 tights 34s
369 skirt tenetur
370 resplendent Munchmallows
371 coral Antenna
372 polished outcoming
373 tablecloths Gaeumannomyces
374 spotted Culross
375 wrinkle Thanquo
376 fine panopticon
377 breeches Multitude
378 stockings Porthmoina
379 oval OLLIER
380 greaseproof Adamek
381 pyjama weasel
382 calico SPECTROMETER
383 hues Shielding
384 weave dunnos
385 blotched Luddesdowne
386 oblong Colvern
387 drooping ‘State
388 plastic jewelled
389 jeans Alphatronic
390 colour 198os
391 longish ×11
392 rayon waives
393 slanting R150
394 lacquered FRENCHAY
395 bridal Shepperdson
396 fake Mr Victorino
397 fitting Midas
398 discoloured mGal
399 light garish
400 puffy wax
401 ebony ripstop
402 clinging INITIAL
403 Soft homotransplants
404 warm ‘enlargement
405 latex Fashionable
406 flannel connotated
407 flickering BARLASTON
408 crested unphysiologic
409 gilt recalcitrance
410 glittering overwhelmimg
411 slim Assimularum
412 tufts shaggy
413 neat procedurely
414 dampened plasmic
415 holly Huddersfield…
416 skimpy 357
417 napkins discoloured
418 covered traversers
419 azure Debriefed
420 quilts Chakri
421 battered Yeager
422 leaf Tanichthys
423 sheepskin shine…
424 foliage maintance
425 hessian kwoon
426 sparkling Dated
427 metallic Mallei
428 marzipan Grassmarket
429 wisps aparthied
430 knit pusilla
431 springy commmunity
432 tailored 30287
433 coat Pinguli
434 pitted Kouyate
435 blazer Atwater
436 ashen soul…
437 frosted reinstalls
438 hugging Esser
439 fading STUTTARD
440 bald RICO
441 underneath 15billion
442 cloudy TINGAY
443 rustling putrefaction
444 leggings mandrills
445 perfumed ameasure
446 Bright picking
447 neon overpriecd
448 filament aftershocks
449 caked 33min
450 straggling Rusu
451 cut reinterprets
452 shabby cetane
453 pair backslaps
454 bead 36403
455 cloth 35845
456 vests MDA
457 knotted holdful
458 smoothing Benzel
459 quartered noronhianum
460 cardigans Création
461 zipped airbrushing
462 mop 48
463 laced cherry
464 sequins Taglialatela
465 bulging McKENZIE
466 pile Franjiyah
467 pendants thicker
468 pullover Playle
469 sweaters Meanwood
470 ginger asymptotically
471 flowing Sephton
472 redness Perring
473 jerseys Gawn
474 twinkling imploded
475 globular consultat
476 yellows bossiest
477 bulky reinvesting
478 brushed Quarryman
479 weathered 9BY
480 patchy brioche
481 shirt Biceps
482 unsightly Athelstone
483 Matching milky
484 colours Labden
485 stuffed HAPPENING
486 rimmed 35006
487 bonnets Descents
488 shreds carburettors
489 drab ANNULLED
490 variegated stabilizers…
491 folded SRPS
492 grimy Shatalin
493 glint Frolunda
494 unwashed Precipitation
495 discarded Dyli
496 smoky becos
497 moistened Watson’s
498 pearls reigneth
499 supple cruisy
500 misty unprejudiced
501 laundered monologuing
502 bristling Arlingham
503 charred SAFARI
504 canvas Mulder report
505 bronze Leavism
506 plump trala
507 wallpaper Souchong
508 viscose pinniped
509 large Hubner
510 dabbed GERBER
511 waistband Eginhard
512 Leather repetivity
513 moist ple
514 tunic DosFax
515 pallid Nettos
516 anorak Cardmember
517 lighter 300µ
518 marbled polyester
519 heeled Wisk
520 beads Meyssac
521 sprouting Menial
522 earrings zest
523 beautiful korm
524 diamond Crumbleholme
525 fleece countryside…
526 soak hooded
527 blazing ILE
528 blonde gooks
529 Silk Burrells
530 unkempt clotted
531 sheets Vick
532 burnt Padric
533 furs inefficiency’
534 bikini TH
535 acrylic Gontcharova
536 polish fleecewear
537 hats Rougement
538 canary McMahons
539 dishevelled COWBOY
540 dove candle
541 glassy Osley
542 soaking gluconeogenic
543 daisies Abernant
544 tarred p603
545 luxuriant Musicale
546 Colours Creamstick
547 sprayed Sepolcro
548 proofed Isireli
549 greased Gomolzig
550 ribbons Tantric
551 ripping pitchshifter
552 ruff A698
553 petticoat Sellick
554 studded Kucera
555 slender forestalling
556 stray artound
557 dry blossom
558 borrowed Virginiamycin
559 lime dideoxynucleoside
560 dull Ablington
561 powdery Laniel
562 jackets introverts
563 fingering barne
564 impregnated wryed
565 charcoal Tablecloth
566 pencil shall…
567 lemon Luciers
568 fabrics sallow
569 lumpy XZ
570 tubers recommit
571 handmade Brueghelesque
572 fragrant NIA
573 tarnished colas
574 ringed Angouleme
575 christening Moston
576 plum heifers…
577 spiny Benthamism
578 rippling TURBOCHARGER
579 crushed tailplane
580 Tiny pristina
581 conical Matterson
582 spotless txt
583 scraps prizewinning
584 Nylon Phelps…
585 chintz SUSPECT
586 lotus RA2
587 rough Dauson
588 Armani Vistec
589 walnut differention
590 embossed Aaronis
591 scratchy sighed…
592 blackened recheck
593 clumps Conference…
594 daisy seablite
595 feathers Kalff
596 pierced Jalil
597 lily Reserved
598 rosette FITZ
599 moulded burns…
600 plumes Imlay
601 cherry Grind
602 buttons CRICKLADE
603 scrubbed Chironomids
604 tipped 35800
605 bog 35440
606 lined Menear
607 garlands Yonis
608 long Unaccustomed
609 flower Filtertrons
610 skins tangent…
611 sweater ScanWorX
612 wreaths Perón
613 big Shomron
614 tapered counterpointed
615 sparse birdfeeder
616 trails Watsonians
617 flaking Loofah
618 hoop Heihachiró0
619 looping CHOLANGITIS
620 flaring Spray
621 chrysanthemums plucked
622 jagged HAYES
623 puff COWGILL
624 framing Affreca
625 indelible stockyard
626 shoes Sew
627 glistened oppin
628 crescent equids
629 pelmet Pesth
630 aprons 829934
631 autumnal 38285
632 brighter Wrighting
633 shrivelled Sima
634 blossom Almeyda
635 incandescent reedbed
636 handkerchiefs Chis
637 jacket 0X14
638 sickly MiL
639 Pink homesteads
640 leaden aeriological
641 lurid brigged
642 spare tartan
643 softer Orgasmic
644 hazy Bosher
645 cloaks 3 billion
646 lipstick sunbronzed
647 ply M2000
648 hairy 4000rpm
649 heather monorails
650 filigree
651 flattened 6340
652 polishing 6308
653 uncut mee
654 sheen Chasserieau
655 flawless calabrese
656 mustard NYMR
657 carat Cionnaith
658 sandalwood 14g
659 greys preconditions…
660 lovely Jigsaw…
661 smart ciliary
662 colouring uncontestable
663 sleeve Lightup
664 small Hunterson
665 puffs colossuses
666 sagging Aviv11
667 browns ALUMNI
668 complexion prospering
669 sweatshirt Coenzyme
670 balding BRAC1
671 toffee Boeschen
672 trouser UV
673 decorated lilies
674 lilies Quaranta
675 berries ORGANIZATION
676 pants Discocam
677 paint Cuj
678 gleam mint
679 muddy nystatin
680 bodice Gerad
681 ubiquitous Cyzicus
682 shaven VILES
683 brittle Spaceway
684 cardboard Leff
685 skirts Glenochil
686 scruffy Brunell
687 splashed benzhydryl
688 jumper Urquiza
689 unopened Retrovirus
690 dusting Danielles
691 fresh Lorrazo
692 sew caringly
693 flamed antic
694 Liberty gns
695 ironed Eworp
696 slimy Choleitis
697 gilded flecks
698 vest lapel
699 tortoiseshell Waldachquelle
700 watery pensioned
701 sock Lotery
702 burning depanments
703 branched semaphore
704 winged fluffy
705 ivy cryonic
706 huge Biomimetic
707 stubby AEROBIC
708 petals VW
709 gnarled IL6b
710 pasty Glitterbest
711 iris enjoying…
712 flowers PERSPEX
713 checked hoes
714 slacks 930410
715 broken Vremya
716 embroidery Peneva
717 detachable storybook
718 mossy Cherryh
719 limp Balmbra
720 whiteness gorse
721 conspicuous Glossatella
722 bristle camps…
723 rubies Baverstock
724 prettiest Priester
725 tall Partlett
726 withered destabilized
727 shawls daisies
728 neckline spankers
729 emeralds skunktail
730 fiery cropmarks
731 collar transients
732 foil stedefast
733 toned coxite
734 stitched Batteux
735 filler gloss
736 ribbon swished
737 fat interdefinable
738 braid CATI
739 beard biomagnification
740 antique dab
741 honeyed velvet
742 fancy Value………………………
743 nondescript NDEP
744 spotty Gencer
745 sallow Tomme
746 jewel forties…
747 boots fleurs
748 rustle Républicain
749 scarf Kuldip
750 skin Gradu
751 threaded Emigration
752 Choose pea
753 wood Placid
754 horny Pfarrkirche
755 rusty Lidia
756 shedding Roncagliolo
757 nice Remeliik
758 bloodied Koupetschesky
759 waving wreaths
760 arching Bare
761 soggy towelling
762 squat snowbridges
763 flat Carita
764 spurs Boèce
765 proverbial Yasa
766 misshapen Sleeve
767 outer schlemiel
768 zebra Biddics
769 vinyl Ll
770 stout HepG2
771 grit Gwynion
772 squashed TYRANT
773 cuffs tossed…
774 jacquard Mikoian
775 rosewood poppies
776 trim interactants
777 skirted DECIDING
778 irises 9186
779 layers Micah
780 smelling BAZALGEE
781 inch Anu
782 thinner pencilled
783 brush LIPA
784 honey Kutnick
785 swarthy Catalyst
786 prickly Investronica
787 garland himeslf
788 sized Clarkes
789 thickness chiffon
790 claret ultramarine
791 sleeves Moraes’
792 fluttering Brantôme
793 dress Biella
794 chrome shiksas
795 tasteful Rosehearty
796 nape Neutron
797 blouse Ceterum
798 fetching Arabesque
799 shorn Altitudes
800 Cotton Classing
801 caps Basalts
802 snowy 6346
803 raincoat Skjelstad
804 absorbent Alken
805 sage 2174
806 wiry leopard
807 strawberry Nimr
808 elasticated crisis…
809 fabric cogitated
810 spindly Puanga
811 expanse McLeary
812 ornamented bel…
813 coiled vibromassage
814 Huge METABOLIC
815 snowdrops 70D
816 sunglasses SaO
817 paper KAZAN
818 stemmed Ikons
819 powder veche
820 snaking Munroists
821 halo lebanon
822 lazuli cruise…
823 pulling CONSUMPTION
824 bales chemcials
825 garnet tungsten
826 lapel Strijd
827 brushes OFI
828 silvered beylerbeyi
829 dislodged Lowdens
830 splashes Crossraguel
831 dim Anaxis
832 distinctive unornamented
833 worsted Jubbergate
834 bearing 1342
835 pieces grape
836 interlaced Strandley
837 smouldering Ns
838 elm HENCHER
839 spinning Kneecap
840 wreath flybar
841 blobs Toner
842 picking proscuting
843 bluebells 5569
844 shredded PERSHORE
845 thickening miocenia
846 Leaves Briancon
847 strip Terrorize
848 square praying…
849 spongy COSATU
850 clutching Mibenge
851 streaming hollies
852 frock Cerrej
853 foam Thirlmere
854 barred Rendition
855 helmet Brokes
856 succulent honeyed
857 roses theres
858 boned sweden
859 copper priately
860 humped 8TR
861 pristine Penylan
862 turban incon
863 wrap Bhadra
864 bunches hambre
865 patch divebombing
866 rims absi
867 hazel roses
868 untidy crackle
869 scarves obrigado
870 bare hea
871 poppy Fortrey
872 musk LIVID
873 wash Creamware
874 grained sunclocks
875 leaves Peep
876 coconut FILLON
877 murky Gerlaud
878 upturned Cotingidae
879 bottoms Connecting
880 straightening argu
881 finer persons’
882 tinder LLC
883 deep indistinctness
884 spray smellies
885 shouldered Convene
886 solid CLARIS
887 mahogany Sneh
888 neck schematized
889 plated Maplins
890 wizened Jain
891 tearing E408
892 double Upottery
893 layered Redskin
894 waistcoat Cuchinan
895 Dark lentoid
896 corkscrew Bowery
897 cone ARTscribble
898 colourless uncomfy
899 mane Oddfacts
900 cool famille
901 puckered Paritsa
902 invisible midis
903 thread ESSE
904 hair centaury
905 ink ‘stopping
906 submerged Palafox
907 giant Indegestion
908 sewing biffos
909 gilding chilli
910 rubbed oyster
911 straight Collingbourne
912 bamboo Chambord
913 quartz aec
914 pine Pectinid
915 decorative maximisers
916 tuck fatalist
917 miniature Tavola
918 pith morosus
919 polyurethane matriculation
920 tips ‘SMEs’
921 ghostly Yat
922 parched Mr Guardans
923 immaculate Bytlm
924 folding hinter
925 flinging Godowski
926 soapy Cottesmore
927 little puffer
928 threads HELLINCKX
929 frocks genitors
930 pressed specks
931 carved woven
932 porous Skeppargatan
933 bark Desforges
934 laurel certitude
935 inlaid GB5OWA
936 rosettes Delbigot
937 corrugated ANTONIO
938 bits Parishenors
939 polypropylene idiocies
940 raven Cassian
941 blob ruralists
942 vivid meva
943 gorse Diag
944 tooth mobius
945 silks McEnery
946 sprouted Gandini
947 Smooth tallow
948 darned TAKA
949 brass PERSPIRANT
950 pewter Brochure
951 starry hagiographical
952 blurred DSDL
953 ash blackamoor…
954 edges THERESIA
955 tucking Kominsky
956 cap congratters
957 dusted Plexaurelia
958 encased Mayrhofen
959 rubbery boyu
960 resemble Rzeszow
961 frills playsafe
962 strips Birkin
963 berry 540534865
964 hat flash
965 spikes unsat…
966 vibrating dyssynergic
967 colourful budwood
968 wrapping Cantley
969 Grey Arcadiae
970 shorts 35690
971 rounded streamers
972 blacker Watadar
973 tapering Mortimers
974 pear 2500km
975 pared loaning
976 beaver Hutchens
977 blackcurrant Blake…
978 cascading terbutaline
979 tops preoccupied…
980 wide messiah
981 curved BACKBITING
982 lettered De
983 stitch tilling
984 dried Jubb
985 flapping gem…
986 crusty patrimonies
987 triangular Nevsky
988 imitation FORESKIN
989 mink Tiaan
990 polythene neckroll
991 glass 5390
992 chandeliers sialyl
993 scratches Coughing
994 twirling Chemsafe
995 slit poppin
996 hanging Bocharov
997 shell 109G
998 oyster QUINTIN
999 sycamore phenomenalist
1000 reversible Hillyards
1001 suffused dim
1002 violets Narcolepsy
1003 whipped ELECTROCUTION
1004 lump Breakage
1005 streamers XL70
1006 brushing Awad
1007 sculpted 6049
1008 sheet Misérables
1009 pointed Clubturf
1010 hot Bashkirria
1011 maple coriander
1012 mellow McKeller
1013 twisted Lydie
1014 clipped Iddon
1015 shaved Realisation
1016 rosemary prehybridized
1017 upholstered Platonov
1018 blossoming Serei
1019 carpets intelligen
1020 Bare Capers
1021 pairs traffics
1022 cupped originali
1023 almond Lahej
1024 honeysuckle stalky

Visualize methods performance vs NCISC on 20newsgroups

As I wrote in my last post, my methods improves things a lot on the datasets I’ve tried. The most impressive in on 20 newsgroups, mainly because I can use the full, unaltered original data easily (and thus that’s what I do).

I’ve used a classical random 80/20 split. The results are very consistent between various splits, but the results published in the Precision/Recall graph here are from a single split (I’m too lazy to change my code to average the results over several splits).

20ng

The format of the legend is as follows : Method name (Number of final features when relevant)(Time for dimension reduction) [ Regularization ]: Precision/Recall curve evaluation time

The methods :

  • none means doing nothing, and just using the raw regularized data (distance for the 1-NN is cosine)
  • LSI means that I used MATLAB’s svds to compute U and V (computing just U is not faster)
  • ISC is my fast LSI method (Precision/Recall are the same for both methods).
  • NC-ISC-2 is my little secret method
  • NC-ISC-2+SS is the same but with semi-supervised class information added

The initial learning matrix is 12590 documents * 57900 words, with 1.6 Million values. My computer is a Q6600 (quad core) running at 2.4Ghz, with 8GB memory. BTW, it seems that I was wrong about the time taken to perform the TFIDF, it takes less than a second, not three seconds. Apart from the precision/recall improvement, I’m really focusing on the speed, and as I wrote in my first post, my work on the GPGPU is really producing results on improving my method speed. Doing better than MATLAB is not difficult, but the performance I reach is this : a 500000×500000 sparse matrix containing approximately 20 million values is reduced in 30 sec with a GTX 280.