C# Eggheads

Matt · Dec 16th 2011, 6:09pm

Anyone here got some talent with C# and can push me in the correct direction? I'm working on an application that reads a .txt file full of hashtags from Twitter and I am trying to figure out:

How many hashtags are in the file
Number of individual hashtags

To be honest, I'm completely stumped. Also, if there's an alternative method for stopping a file from being read, instead of a while loop with != null then that'd be great too. As I found somewhere that a while loop (or probably even recommended it) would stop the file writing the lines if it was equal to null, but it fails every time.

Ziggs · Dec 16th 2011, 6:11pm

Misfits :cade:

DamnImGood · Dec 16th 2011, 6:13pm

I might be misunderstanding something about Twitter, but aren't both those problems the same problem?

Personally in a situation like this I would probably use a regular expression.

Also, to exit a loop early you can use the break statement.

Can you post a sample of the file you're reading?

Matt · Dec 16th 2011, 6:19pm

This is the file I'm reading:

Source Code

<pre><p>#vote1direction
#paintobray
#phonehand
#1direction
#harry
#twibbon
#1directiontowin
#harryhill
#harryhillstvburp
#casualty
#one
#harryhill.
#aiden
#teamfollowback
#1direction
#rebeccaferguson
#tweet
#1direction
#teamminogue!!!
#teamcheryl
#strickly
#scd
#twibbon
#1directiontowin
#birmingham
#tvburp
#scd
#scd
#strictly
#panic
#cherlloyd
#scd
#cherandkatiemakemeangry
#harryhill
#scd
#1direction
#tvburp
#tvburp
#bieberfact
#nlp
#scd
#storm's
#shutup!!!
#ladygaga
#scd
#twibbon
#nicolotowin
#harryhillstvburp
#bieberfact
#storm's
#tvburp
#itv1
#twibbon
#1directiontowin
#twibbon
#matttowin
#vote1direction
#strictlycomedancing
#dassupertalent
#vote1direction
#bitchfest
#vote1direction
#thexfactor
#xtrafactor
#fml
#offline
#scd
#bieberfact
#twibbon
#1directiontowin
#higher
#teamsats
#vote1direction
#bieberfact
#harryhill
#neonrainbow
#timetofacethemusic
#yourweekendstartshere
#tvburp.
#strictlycomedancing
#bieberfact
#deportationfactor
#vote1direction
#higher
#teamsats
#twibbon
#chertowin
#scd
#moreteavicar
#harryhill
#teammary
#bringbackdivafever
#thexfactor
#strictly.
#johnadeleyex!
#1direction
#tescomary
#itv
#strictly
#hmm.
#very
#ineedalife.
#1direction
#strictlycomedancing
#strictlycomedancing
#tvburp
#twitter
#twibbon
#1directiontowin
#harryhill
#harryhill
#modernfamily
#cherylcole
#in10years
#goodluck1d
#grandprix
#teamcheryl
#scd
#nfl
#onlycoswehaveabigteleupstairs
#teamminogue
#scd
#offline
#strictly
#scd
#harry
#teamcheryl
#teamdermot
#teamchermot
#fb
#scd
#scd
#itbegins
#teamcheryl
#teamcherlloyd
#twibbon
#matttowin
#1direction
#ineedalife.
#harryhill
#nowwatching
#1direction
#1direction!
#vote1direction
#vote1direction
#scd
#onedirection
#sytycd
#onedirection
#twibbon
#chertowin
#vote1direction
#ff
#fs
#cherylcole
#mattcardle
#cherylsoldiers
#vote1direction
#gamu
#cherylcole
#gamu
#scd
#thedeparture
#fail
#twitter
#bringbackgamu
#teamdannii
#onedirection?
#vote1direction
#corrie
#reallysurprising
#nom
#celebrityjuice
#harryhill
#scd
#simoncowell!
#strictlycomedancing
#cherlloyd
#katie
#makeovers
#bullet4cheryl
#nowwatching
#cardle
#strictlycomedancing
#stonecoldgamu
#fb
#scd.
#scd.
#fyd.
#merlin
#rebecca
#twist
#now
#tvburp
#vote1direction
#scd.
#onedirection
#donotdisturb
#belami
#yay
#matt
#mary
#rebecca
#teambelleamie
#itv1
#fyd
#omgxfactor!!!!!!!!!!!!
#itv1
#stv
#utv
#live
#direkt
#scd
#teamminogue
#stormlee
#twistfactor
#stonecol
#stonecol
#teamcherlloyd
#johnlennon
#merlin
#bbc1!#merlin
#letsgo
#divafever
#miss
#boycott
#fail
#cherleader
#cherlloyd
#thexfactor
#doctorwho
#tvburp!
#endtimes
#1970election
#scd
#bloodylovesaturdaynightsinfrontofthetelly
#cherlloyd
#bringbackmattscap
#bitchfest</pre>

Display All

Also, just to point out I'm no amazing pro at C# either. So I only at the moment maybe basics. I came up with a theory to attempt to count # each time it was read, but that failed dramatically; I would count per line, but that doesn't mean it was a hashtag. As for counting individual tags (disregarding repeated tags) I haven't attempted yet, and doubt I could until I crack how to count.

Rave · Dec 16th 2011, 6:40pm

I might misunderstood what problem is but, as I get
you can simply count how much lines are there (with some TXT editor)
and then use

for(int n=0; n<C; n++)

where C is number of lines in TXT

and it would stop reading from files, untill it reaches C (number of lines)

Matt · Dec 16th 2011, 6:43pm

True I can use a the code to read the lines, but I thought if I wanted to make it a bit more robust, could I not have some way of reading # and incrementing a counter?

Rave · Dec 16th 2011, 6:53pm

ah, so you want to count a lines depending on # quantity?

I guess, you can simply use strings, while and if, like
to get how many ' # ' is in in sentense, you can use

string Str;
int counter =0, i =0;
ifstream ifs("sample.txt");
ifs>>Str;
///////getline(Str);
while(i < Str.size()){
if( Str == '#' )
counter++;
++i;
}

I'm not sure if it does work, but you can still try..

---------- Post added at 10:53 PM ---------- Previous post was at 10:51 PM ----------

and to get it on command line ..

cout<<"there are "<<counter<<" lines "<<endl;

but that will work only, if only 1 # is per line.. because it counts quantity of #, and not lines.
unfortunetely, I don't know another much tricky way

anyways, for this time I only know some basics of C++, dont even know if it corresponds C#

Wait, there doesn't need

getline

<<

Matt · Dec 16th 2011, 7:23pm

Yeah, your code didn't work for me too well but has helped a tad; I think. I managed to get what you gave me to work to a certain degree, though it didn't really help me at all as the results ended up being like this:

Here's the code of what I was messing with:

Source Code

line = HashFile.ReadLine();
int counter = 0, i = 0;
FileStream ifs = new FileStream("tweets.txt", FileMode.Open, FileAccess.Read);
while ((line = HashFile.ReadLine()) != null)
{
// Write a line of text to the file
//theHTML.WriteLine(line);
Console.WriteLine(line);
// Read the next line
line = HashFile.ReadLine() + "r";
while(i < line.Length)
{
if( line[i] == '#' )
{
counter++;
}
++i;
}
Console.WriteLine("{0}t{1}", counter, i);
}

Display All

Rave · Dec 16th 2011, 7:46pm

well, I wrote there C++ code, (the only thing I know now

) wanted to show you an idea, not actually a correct code to make it work.

anyways, Im happy I helped you at least a little :p

while(i < line.Length)
{
if( line == '#' )
{
counter++;
}
++i;
}

yeah, that;s the main thing I suggest, to count only # ( as there was only one # per line ), that would have worked

---------- Post added at 11:46 PM ---------- Previous post was at 11:39 PM ----------

So, does this work?

line = HashFile.ReadLine();

int counter = 0, i = 0;
FileStream ifs = new FileStream("tweets.txt", FileMode.Open, FileAccess.Read);

while ((line = HashFile.ReadLine()) != null)
{
// Write a line of text to the file
//theHTML.WriteLine(line);
Console.WriteLine(line);

// Read the next line
line = HashFile.ReadLine() + "r";

while(i < line.Length)
{
if( line[i] == '#' )
{
counter++;
}
++i;
}
Console.WriteLine("{0}t{1}", counter, i);
}

Matt · Dec 16th 2011, 7:47pm

Not really, look at my previous post. I posted the picture of what it shows, I don't get an overall value.

Rave · Dec 16th 2011, 7:50pm

damn
well, I'll try to write it correctly on C++ and compile, then you try to convert it into C#. let's see if I success

Matt · Dec 16th 2011, 7:54pm

Altered the code slightly and I'm getting somewhere now, although I did a line count in Word and it reports 239 lines where as my code reports 119 #'s yet that's wrong. =/

Source Code

line = HashFile.ReadLine();
int counter = 0, i = 0;
FileStream ifs = new FileStream("tweets.txt", FileMode.Open, FileAccess.Read);
while ((line = HashFile.ReadLine()) != null)
{
// Write a line of text to the file
//theHTML.WriteLine(line);
Console.WriteLine(line);
// Read the next line
line = HashFile.ReadLine() + "r";
if (line[i] == '#')
{
counter++;
}
}
Console.WriteLine("{0}", counter);

Display All

Rave · Dec 16th 2011, 8:14pm

Matt wrote:

Altered the code slightly and I'm getting somewhere now, although I did a line count in Word and it reports 239 lines where as my code reports 119 #'s yet that's wrong. =/

Source Code

line = HashFile.ReadLine();

int counter = 0, i = 0;

FileStream ifs = new FileStream("tweets.txt", FileMode.Open, FileAccess.Read);

while ((line = HashFile.ReadLine()) != null)

{

// Write a line of text to the file

//theHTML.WriteLine(line);

Console.WriteLine(line);

// Read the next line

line = HashFile.ReadLine() + "r";

if (line[i] == '#')

{

counter++;

}

}

Console.WriteLine("{0}", counter);

Display All

can you PrintScreen what was the result?

Matt · Dec 16th 2011, 8:17pm

It basically displays the entire list, then below the list the counter which it displays as "119". When there's well over 119 hashtags.

DamnImGood · Dec 16th 2011, 11:16pm

I would read each line of the file into an array list and then go from there.

EDIT: If you're testing for duplicates, check the array list for the current value. If it exists, move on. If it doesn't, add it.

Matt · Dec 16th 2011, 11:36pm

And this is where I go.... How exactly?

I still haven't got my head around arrays well (our tutor really doesn't do lectures well to be honest). An brief example would be great, if you could provide one.

Albus Dumbledore · Dec 17th 2011, 5:58am

I could do this in nice and quick in Java, but then no one would probably touch it with a 10 foot pole :p :lol:

Matt · Dec 17th 2011, 9:27am

Lol, I know I wouldn't.

Matt · Dec 17th 2011, 10:44am

After a good rest, and a re-read of a website and copying it, then altering it, I've finally managed to get my result. The only issue I have now is, I thought it'd be more suitable for the code to have it's own method, then I can call it in the Main but I can't return a variable in an If statement. =/

EDIT: Scratch my return issue, I fixed it.

Secondly, is anyone willing to tell me what each line in the code box below does? So I at least can get a better understanding of it.

Source Code

{
//Array to store frequencies.
int[] c = new int[(int)char.MaxValue];
//Read entire text file.
string s = File.ReadAllText("tweets.txt");
// Iterate over each character.
foreach (char t in s) // What has t got to do with this?
{
// Increment table.
c[(int)t]++; //Unsure if I understand this.
}
// Write all letters found.
for (int i = 0; i < (int)char.MaxValue; i++) //For every time char.MaxVal is more then i, increment by one. Right?
{
if (c[i] > 0 &&
char.IsPunctuation((char)i))
//This is where I got lucky, thanks to VS. I changed a part and replaced it with IsPunctuation, but I'm unsure about the rest of that if statement.
//All I can make from it, from testing it was.. If the array c is more than 0 and at the same time the char i is a puncuation, then do shit in the code below.
{
if ((char)i == '#') // This is where I shine, I wrote this based on parts of code above. =]
{
Hashresults = c[i]; //I added this, and I wanted to use it as a return, but it is complete failure at the moment.
//Console.WriteLine("Letter: {0} Frequency: {1}", (char)i, c[i]);
}
}
}

Display All

DamnImGood · Dec 18th 2011, 10:14pm

I'm not sure why they're doing all the typecasting in the code. Should be able to do it without it, but whatever works.

One quick tip when writing code: give your variables meaningful names. "c", "t", "s", etc. aren't very meaningful; they tell you nothing about what's being stored in those variables and it makes reading and debugging much more difficult. It's an unfortunate trend with JavaScript developers. They do it to conserve script size (and to obfuscate their code), but it's annoying as hell.

Matt wrote:

Secondly, is anyone willing to tell me what each line in the code box below does? So I at least can get a better understanding of it.

It's been a while since I worked with .NET but I'll give it a quick shot.

Source Code

//Array to store frequencies.
int[] c = new int[(int)char.MaxValue];

Creates the array.

Source Code

//Read entire text file.
string s = File.ReadAllText("tweets.txt");

Pulls the entire text file into a string (wouldn't recommend doing this).

Source Code

// Iterate over each character.
foreach (char t in s) // What has t got to do with this?
{
// Increment table.
c[(int)t]++; //Unsure if I understand this.
}

The "t" variable is just a temporary variable used for the foreach loop. What it's doing is for each char in the variable "s", increase that char's count in your main array. Remember strings are just a sequence of characters (hence the name "strings" - "string of characters").

Source Code

// Write all letters found.
for (int i = 0; i < (int)char.MaxValue; i++) //For every time char.MaxVal is more then i, increment by one. Right?
{
if (c[i] > 0 &&
char.IsPunctuation((char)i))
//This is where I got lucky, thanks to VS. I changed a part and replaced it with IsPunctuation, but I'm unsure about the rest of that if statement.
//All I can make from it, from testing it was.. If the array c is more than 0 and at the same time the char i is a puncuation, then do shit in the code below.
{
if ((char)i == '#') // This is where I shine, I wrote this based on parts of code above. =]
{
Hashresults = c[i]; //I added this, and I wanted to use it as a return, but it is complete failure at the moment.
//Console.WriteLine("Letter: {0} Frequency: {1}", (char)i, c[i]);
}
}
}

Display All

The for loop is looping through every possible character and seeing if it's a hash character. I think.

Looking back at this issue I would have done this as a two-dimensional array. The total hashes is easy since each line only has one hash, therefore the total lines is the total hashes.

For the second problem I would test each hash if it exists in my array. If it doesn't, then add the hash to the array in the first dimension, and in the second dimension with a value of 1 (the number of occurrences - will be 1 for the first time of course). If it does exist, then increase the corresponding hash's second dimension by 1. PHP has an in_array() function. I imagine .NET has something similar.

I'm going to do this in PHP with the sample you posted and then post the code.

C# Eggheads

C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Striker88;1062839033 wrote:

Re: C# Eggheads

Source Code

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Source Code

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Source Code

Re: C# Eggheads

Matt wrote:

Source Code

Re: C# Eggheads

Re: C# Eggheads

Striker88;1062839033 wrote:

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Re: C# Eggheads

Source Code

Re: C# Eggheads

Matt wrote:

Source Code

Source Code

Source Code

Source Code

Striker88;1062839033 wrote:

Share