Am i the primary caregiver?

my boyfriend and i are not married and we have a 1 year old together and have split up. he had very bad anger issues and because of the way his job is, hes never home to actually spend any real time with me or our daughter. we knew we'd have to take it to court for custody eventually and hes just making worse. he says because hes the one with the job (i have none and live with my parents now) and has 1 extra room for her that he will win and just to make it look good in court he'll get "counciling" for his anger. and thats a guaranteed win for him. ive always been the one with the baby basically from day 1. the only time ive not been with her and he has had real time with her was when i was working during the day and he had to watch her. if i was home he would NEVER feed her, change her diaper, hold her (cuz all she used to do was scream for him, he was never really around her so she didnt know him) , and barely played with her. ive got pictures of all the holes hes punched in the walls from anger between his boss telling him he had to work and from the baby crying cuz she wanted me. ive called a lawyer for free counciltation and they said even tho the only thing that he has on me is he has a job, it sounds like im the primary caregiver but im sooooooo worried that he will win custody. i dont want my baby to be around his anger. :( please help me out and give me input on any of this